Apr 20 23:30:19 devstack cinder-volume[72934]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 23:30:19 devstack cinder-volume[72934]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 23:30:19 devstack cinder-volume[72934]: we strongly recommend against using it for new projects.
Apr 20 23:30:19 devstack cinder-volume[72934]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 23:30:19 devstack cinder-volume[72934]: framework.  For more detail see
Apr 20 23:30:19 devstack cinder-volume[72934]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 23:30:19 devstack cinder-volume[72934]:   import eventlet  # noqa
Apr 20 23:30:20 devstack cinder-volume[72934]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:30:20 devstack cinder-volume[72934]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:30:20 devstack cinder-volume[72934]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO dbcounter [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Registered counter for database cinder
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_db.sqlalchemy.engines [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG dbcounter [-] [72934] Writer thread running {{(pid=72934) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.rpc [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.rpc [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_db.sqlalchemy.engines [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.volume.manager [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Determined volume DB was empty at startup.
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG cinder.volume.manager [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72934) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.volume.manager [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 20 23:30:21 devstack cinder-volume[72934]: WARNING stevedore.named [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 23:30:21 devstack cinder-volume[72934]: WARNING castellan.key_manager [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:30:21 devstack cinder-volume[72934]: WARNING cinder.keymgr.conf_key_mgr [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG cinder.volume.drivers.lvm [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72934) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_concurrency.processutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_concurrency.processutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.225s {{(pid=72934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_db.sqlalchemy.engines [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.rpc [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.rpc [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 20 23:30:21 devstack cinder-volume[72934]: WARNING stevedore.named [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 23:30:21 devstack cinder-volume[72934]: WARNING castellan.key_manager [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO cinder.volume.manager [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_db.sqlalchemy.engines [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:30:21 devstack cinder-volume[72934]: INFO oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Starting 1 workers
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Started child 73072 {{(pid=72934) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Full set of CONF: {{(pid=72934) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] ******************************************************************************** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Configuration options gathered from: {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] ================================================================================ {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] allow_availability_zone_fallback = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[73072]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] allow_compression_on_image_upload = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] allowed_direct_url_schemes     = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] api_rate_limit                 = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] auth_strategy                  = keystone {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] az_cache_duration              = 3600 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_availability_zone      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_host                   = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_name                   = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_stats_polling_interval = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backup_api_class               = cinder.backup.api.API {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backup_name_template           = backup-%s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backup_use_same_host           = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backup_use_temp_snapshot       = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] chap_password                  = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] chap_username                  =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_internal_tenant_project_id = cd6ca1072cfd4225aab446ba43bbb18a {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_internal_tenant_user_id = e9fcdbbb82654964b697e8fa9116d846 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cloned_volume_same_az          = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cluster                        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] compression_format             = gzip {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] config_dir                     = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] config_source                  = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] control_exchange               = openstack {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] debug                          = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] default_availability_zone      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] default_group_type             = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] default_volume_type            = lvmdriver-1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] disk_geometry                  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] driver_client_cert             = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] driver_client_cert_key         = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] driver_data_namespace          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] driver_ssl_cert_path           = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] driver_ssl_cert_verify         = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] driver_use_ssl                 = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] enable_force_upload            = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] enable_new_services            = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] enable_unsupported_driver      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] enforce_multipath_for_image_xfer = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] filter_function                = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_api_insecure            = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_api_ssl_compression     = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_ca_certificates_file    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_certfile                = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_keyfile                 = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_num_retries             = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance_request_timeout         = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] goodness_function              = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] graceful_shutdown_timeout      = 5 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] group_api_class                = cinder.group.api.API {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] host                           = devstack {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_compress_on_upload       = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_conversion_address_space_limit = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_conversion_cpu_limit     = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_conversion_disable       = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_upload_use_cinder_backend = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_upload_use_internal_tenant = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_volume_cache_enabled     = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_volume_cache_max_count   = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] image_volume_cache_max_size_gb = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] init_host_max_objects_retrieval = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] iscsi_target_flags             =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] iscsi_write_cache              = on {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] iser_helper                    = tgtadm {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] iser_ip_address                = 192.168.122.185 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] iser_port                      = 3260 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_color                      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_config_append              = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_dir                        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_file                       = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_options                    = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_rotate_interval            = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_rotate_interval_type       = days {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] log_rotation_type              = none {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[73072]: INFO cinder.volume.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] max_age                        = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] max_logfile_count              = 30 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] max_logfile_size_mb            = 200 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] max_over_subscription_ratio    = 20.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] message_reap_interval          = 86400 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] message_ttl                    = 2592000 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] migration_create_volume_timeout_secs = 300 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] monkey_patch                   = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] monkey_patch_modules           = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] my_ip                          = 192.168.122.185 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] no_snapshot_gb_quota           = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] num_iser_scan_tries            = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] num_shell_tries                = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] num_volume_device_scan_tries   = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] nvmeof_conn_info_version       = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] nvmet_ns_id                    = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] nvmet_port_id                  = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_max_limit                = 1000 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_volume_ext_list          = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_volume_listen_port       = 8776 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_volume_use_ssl           = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] osapi_volume_workers           = 2 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] per_volume_size_limit          = -1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] periodic_fuzzy_delay           = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] periodic_interval              = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] public_endpoint                = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] publish_errors                 = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_backup_gigabytes         = 1000 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_backups                  = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_gigabytes                = 1000 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_groups                   = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_snapshots                = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] quota_volumes                  = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] rate_limit_burst               = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] rate_limit_except_level        = CRITICAL {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] rate_limit_interval            = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] reinit_driver_count            = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] replication_device             = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] report_discard_supported       = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] report_interval                = 120 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] reservation_clean_interval     = 86400 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] reservation_expire             = 86400 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] reserved_image_namespaces      = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] reserved_percentage            = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] rpc_response_timeout           = 120 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] run_external_periodic_tasks    = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] scst_target_driver             = iscsi {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] scst_target_iqn_name           = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_down_time              = 720 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] shell_completion               = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] snapshot_name_template         = snapshot-%s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] snapshot_same_host             = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] split_loggers                  = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] state_path                     = /opt/stack/data/cinder {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] storage_availability_zone      = nova {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] storage_protocol               = iSCSI {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] syslog_log_facility            = LOG_USER {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] target_helper                  = lioadm {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] target_ip_address              = 192.168.122.185 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] target_port                    = 3260 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] target_protocol                = iscsi {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] target_secondary_ip_addresses  = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] trace_flags                    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] transport_url                  = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] until_refresh                  = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_chap_auth                  = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_default_quota_class        = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_journal                    = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_json                       = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_multipath_for_image_xfer   = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_stderr                     = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] use_syslog                     = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] verify_glance_signatures       = enabled {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_api_class               = cinder.volume.api.API {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_backend_name            = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_clear                   = zero {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_clear_ionice            = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_clear_size              = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_copy_bps_limit          = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_dd_blocksize            = 1M {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_name_template           = volume-%s {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_service_inithost_offload = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volume_usage_audit_period      = month {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] zoning_mode                    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_concurrency.disable_process_locking = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.admin_password = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.admin_token = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.admin_user  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_protocol = https {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_section = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_type   = password {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_uri    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.auth_version = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.cache       = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.certfile    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.identity_uri = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.include_service_catalog = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.insecure    = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.interface   = public {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.keyfile     = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_password =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcache_username =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.region_name = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.service_type = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.backend                  = dogpile.cache.null {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.backend_argument         = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.backend_expiration_time  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.config_prefix            = cache.oslo {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.debug_cache_backend      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.enable_retry_client      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.enable_socket_keepalive  = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.enabled                  = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.enforce_fips_mode        = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.expiration_time          = 600 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.hashclient_retry_attempts = 2 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_dead_retry      = 300 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_sasl_enabled    = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.password                 = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.proxies                  = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.redis_db                 = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.redis_server             = localhost:6379 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.retry_attempts           = 2 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.retry_delay              = 0.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.socket_keepalive_count   = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.socket_keepalive_idle    = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.socket_keepalive_interval = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.socket_timeout           = 1.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.tls_allowed_ciphers      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.tls_cafile               = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.tls_certfile             = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.tls_enabled              = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.tls_keyfile              = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cache.username                 = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] coordination.backend_url       = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.asyncio_connection    = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.asyncio_slave_connection = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.backend               = sqlalchemy {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.connection            = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.connection_debug      = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.connection_parameters =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.connection_recycle_time = 3600 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.connection_trace      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.db_inc_retry_interval = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.db_max_retries        = 20 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.db_max_retry_interval = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.db_retry_interval     = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.max_overflow          = 50 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.max_pool_size         = 5 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.max_retries           = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.mysql_wsrep_sync_wait = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.pool_timeout          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.retry_interval        = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.slave_connection      = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.sqlite_synchronous    = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.synchronous_reader    = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] database.use_db_reconnect      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.connection_string     = messaging:// {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.enabled               = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.es_doc_type           = notification {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.es_scroll_size        = 10000 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.es_scroll_time        = 2m {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.filter_error_trace    = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.hmac_keys             = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.sentinel_service_name = mymaster {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.socket_timeout        = 0.1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.trace_requests        = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler.trace_sqlalchemy      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler_jaeger.process_tags   = {} {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler_jaeger.service_name_prefix = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] profiler_otlp.service_name_prefix = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.enforce_new_defaults = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: WARNING oslo_config.cfg [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.enforce_scope      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.policy_default_rule = default {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.group          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.helper_command = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] privsep_osbrick.user           = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.group         = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.helper_command = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] cinder_sys_admin.user          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.auth_section      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.auth_type         = password {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.cafile            = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.certfile          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.collect_timing    = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.insecure          = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.keyfile           = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.send_service_user_token = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.split_loggers     = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] service_user.timeout           = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.auth_section            = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.auth_type               = password {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.certfile                = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.collect_timing          = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.insecure                = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.keyfile                 = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.region_name             = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.split_loggers           = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] glance.timeout                 = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.backend_availability_zone = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.chap_password = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.chap_username =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.disk_geometry = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.driver_client_cert = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.driver_client_cert_key = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.driver_data_namespace = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.driver_use_ssl = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.extra_capabilities = {} {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.filter_function = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.goodness_function = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack sudo[73076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.iscsi_target_flags =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.iscsi_write_cache = on {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack sudo[73076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.iser_port     = 3260 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.lvm_share_target = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.lvm_type      = auto {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.num_shell_tries = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:21 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.replication_device = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.report_discard_supported = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.reserved_percentage = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.target_helper = tgtadm {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.target_port   = 3260 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.target_protocol = iscsi {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.trace_flags   = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.unique_fqdn_network = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.use_chap_auth = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_backend_name = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_clear  = zero {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_clear_ionice = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_clear_size = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_reports.file_event_handler = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_reports.log_dir           = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.backend_host       = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.chap_password      = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.chap_username      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.disk_geometry      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.driver_client_cert = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.extra_capabilities = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.filter_function    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.goodness_function  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.iser_helper        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.iser_port          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.lvm_type           = auto {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.replication_device = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.report_discard_supported = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.reserved_percentage = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.scst_target_driver = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.storage_protocol   = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.target_ip_address  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.target_port        = 3260 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.trace_flags        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_clear       = zero {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] lvmdriver-1.volumes_dir        = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_notifications.driver = [] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_notifications.retry = -1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] key_manager.fixed_key          = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.barbican_api_version  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.barbican_endpoint     = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.barbican_endpoint_type = public {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.barbican_region_name  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.cafile                = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.certfile              = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.collect_timing        = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.insecure              = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.keyfile               = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.number_of_retries     = 60 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.retry_delay           = 1 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.send_service_user_token = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.split_loggers         = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.timeout               = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.verify_ssl            = True {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican.verify_ssl_path       = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.auth_section = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.auth_type = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.cafile   = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.certfile = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.collect_timing = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.insecure = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.keyfile  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.split_loggers = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] barbican_service_user.timeout  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.approle_role_id          = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.approle_secret_id        = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.kv_mountpoint            = secret {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.kv_path                  = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.kv_version               = 2 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.namespace                = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.root_token_id            = **** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.ssl_ca_crt_file          = None {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.timeout                  = 60.0 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.use_ssl                  = False {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:30:22 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] ******************************************************************************** {{(pid=72934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 23:30:22 devstack sudo[73076]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:22 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:22 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:22 devstack sudo[73088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:22 devstack sudo[73088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:23 devstack sudo[73088]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.526s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:30:23 devstack cinder-volume[73072]: INFO cinder.brick.local_dev.lvm [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:23 devstack sudo[73357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:30:23 devstack sudo[73357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG cinder.brick.local_dev.lvm [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73072) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 20 23:30:23 devstack sudo[73357]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:23 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:23 devstack sudo[73562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:23 devstack sudo[73562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:24 devstack sudo[73562]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:24 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.967s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:24 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:24 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:24 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:24 devstack sudo[73717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:24 devstack sudo[73717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:25 devstack sudo[73717]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:25 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.530s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:25 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:25 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:25 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:25 devstack sudo[73772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 20 23:30:25 devstack sudo[73772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:25 devstack sudo[73772]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:25 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.440s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:25 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:25 devstack sudo[73778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:30:25 devstack sudo[73778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:26 devstack sudo[73778]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:26 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:26 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:26 devstack sudo[73783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:30:26 devstack sudo[73783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:26 devstack sudo[73783]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:26 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:26 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:26 devstack sudo[73789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:26 devstack sudo[73789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:26 devstack sudo[73789]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:26 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:26 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:26 devstack sudo[73794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:26 devstack sudo[73794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:27 devstack sudo[73794]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.421s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:27 devstack sudo[73798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:27 devstack sudo[73798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:27 devstack sudo[73798]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.524s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:27 devstack cinder-volume[73072]: INFO cinder.volume.drivers.lvm [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:27 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:28 devstack sudo[73809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:28 devstack sudo[73809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:28 devstack sudo[73809]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:28 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:28 devstack cinder-volume[73072]: DEBUG cinder.volume.drivers.lvm [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Updating volume stats {{(pid=73072) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 23:30:28 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:28 devstack sudo[73924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:30:28 devstack sudo[73924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:28 devstack sudo[73924]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:28 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:28 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:28 devstack sudo[73928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:28 devstack sudo[73928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:29 devstack sudo[73928]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:29 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:29 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:29 devstack sudo[74066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:29 devstack sudo[74066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:29 devstack sudo[74066]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:29 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:29 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:29 devstack sudo[74069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:29 devstack sudo[74069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:30 devstack sudo[74069]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:30 devstack cinder-volume[73072]: INFO cinder.volume.driver [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG cinder.volume.driver [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73072) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG oslo_db.sqlalchemy.engines [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73072) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG dbcounter [-] [73072] Writer thread running {{(pid=73072) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG cinder.db.sqlalchemy.api [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Building query based on filter {{(pid=73072) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG cinder.image.image_utils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73072) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 23:30:30 devstack cinder-volume[73072]: INFO cinder.keymgr.migration [None req-6d5dea48-e232-4bc4-8d30-cd531f1b01bf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG cinder.volume.drivers.lvm [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Updating volume stats {{(pid=73072) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:30 devstack sudo[74076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:30:30 devstack sudo[74076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:30 devstack sudo[74076]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:30 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:30 devstack sudo[74082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:30 devstack sudo[74082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:31 devstack sudo[74082]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:31 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:31 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:31 devstack sudo[74085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:31 devstack sudo[74085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:31 devstack sudo[74085]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:31 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:31 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:31 devstack sudo[74091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:31 devstack sudo[74091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:31 devstack cinder-volume[72934]: DEBUG dbcounter [-] [72934] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72934) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:30:32 devstack sudo[74091]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG cinder.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Notifying Schedulers of capabilities ... {{(pid=73072) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:30:32 devstack cinder-volume[73072]: INFO cinder.volume.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Driver initialization completed successfully.
Apr 20 23:30:32 devstack cinder-volume[73072]: INFO cinder.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Initiating service 2 cleanup
Apr 20 23:30:32 devstack cinder-volume[73072]: INFO cinder.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Service 2 cleanup completed.
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG cinder.service [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Creating RPC server for service cinder-volume {{(pid=73072) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG cinder.service [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73072) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 23:30:32 devstack cinder-volume[73072]: INFO cinder.volume.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG cinder.volume.drivers.lvm [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Updating volume stats {{(pid=73072) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:32 devstack sudo[74097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:30:32 devstack sudo[74097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:32 devstack sudo[74097]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.529s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:32 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:32 devstack sudo[74103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:32 devstack sudo[74103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:33 devstack sudo[74103]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:33 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:33 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:33 devstack sudo[74126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:30:33 devstack sudo[74126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:33 devstack sudo[74126]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:33 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:33 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:30:33 devstack sudo[74163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:30:33 devstack sudo[74163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:30:34 devstack sudo[74163]: pam_unix(sudo:session): session closed for user root
Apr 20 23:30:34 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:30:34 devstack cinder-volume[73072]: INFO cinder.volume.manager [None req-0d81fe98-8b4a-42b3-a082-60b9f3d436c0 None None] Driver post RPC initialization completed successfully.
Apr 20 23:30:44 devstack cinder-volume[73072]: DEBUG dbcounter [-] [73072] Writing DB stats cinder:SELECT=4 {{(pid=73072) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:30:44 devstack cinder-volume[73072]: DEBUG dbcounter [-] [73072] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73072) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:31:49 devstack cinder-volume[73072]: DEBUG oslo_service.periodic_task [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73072) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:31:49 devstack cinder-volume[73072]: DEBUG cinder.volume.drivers.lvm [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Updating volume stats {{(pid=73072) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 23:31:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:31:49 devstack sudo[78929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:31:49 devstack sudo[78929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:31:49 devstack sudo[78929]: pam_unix(sudo:session): session closed for user root
Apr 20 23:31:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:31:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:31:49 devstack sudo[78932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:31:49 devstack sudo[78932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:31:50 devstack sudo[78932]: pam_unix(sudo:session): session closed for user root
Apr 20 23:31:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:31:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:31:50 devstack sudo[78940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:31:50 devstack sudo[78940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:31:50 devstack sudo[78940]: pam_unix(sudo:session): session closed for user root
Apr 20 23:31:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:31:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:31:50 devstack sudo[78953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:31:50 devstack sudo[78953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:31:51 devstack sudo[78953]: pam_unix(sudo:session): session closed for user root
Apr 20 23:31:51 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:31:51 devstack cinder-volume[73072]: DEBUG cinder.manager [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Notifying Schedulers of capabilities ... {{(pid=73072) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:32:44 devstack cinder-volume[73072]: DEBUG dbcounter [-] [73072] Writing DB stats cinder:SELECT=1 {{(pid=73072) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:32:44 devstack cinder-volume[73072]: DEBUG dbcounter [-] [73072] Writing DB stats cinder:UPDATE=1 {{(pid=73072) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:32:49 devstack cinder-volume[73072]: DEBUG oslo_service.periodic_task [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73072) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:32:49 devstack cinder-volume[73072]: DEBUG cinder.volume.drivers.lvm [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Updating volume stats {{(pid=73072) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 23:32:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:32:49 devstack sudo[80650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:32:49 devstack sudo[80650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:32:49 devstack sudo[80650]: pam_unix(sudo:session): session closed for user root
Apr 20 23:32:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:32:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:32:49 devstack sudo[80682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:32:49 devstack sudo[80682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:32:50 devstack sudo[80682]: pam_unix(sudo:session): session closed for user root
Apr 20 23:32:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:32:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:32:50 devstack sudo[80720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:32:50 devstack sudo[80720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:32:50 devstack sudo[80720]: pam_unix(sudo:session): session closed for user root
Apr 20 23:32:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:32:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:32:50 devstack sudo[80738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:32:50 devstack sudo[80738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:32:50 devstack sudo[80738]: pam_unix(sudo:session): session closed for user root
Apr 20 23:32:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:32:50 devstack cinder-volume[73072]: DEBUG cinder.manager [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Notifying Schedulers of capabilities ... {{(pid=73072) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:33:49 devstack cinder-volume[73072]: DEBUG oslo_service.periodic_task [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73072) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:33:49 devstack cinder-volume[73072]: DEBUG cinder.volume.drivers.lvm [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Updating volume stats {{(pid=73072) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 23:33:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:33:49 devstack sudo[81886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 23:33:49 devstack sudo[81886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:33:49 devstack sudo[81886]: pam_unix(sudo:session): session closed for user root
Apr 20 23:33:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:33:49 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:33:49 devstack sudo[81898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:33:49 devstack sudo[81898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:33:50 devstack sudo[81898]: pam_unix(sudo:session): session closed for user root
Apr 20 23:33:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:33:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:33:50 devstack sudo[81969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 23:33:50 devstack sudo[81969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:33:50 devstack sudo[81969]: pam_unix(sudo:session): session closed for user root
Apr 20 23:33:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:33:50 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:33:50 devstack sudo[81996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 23:33:50 devstack sudo[81996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:33:51 devstack sudo[81996]: pam_unix(sudo:session): session closed for user root
Apr 20 23:33:51 devstack cinder-volume[73072]: DEBUG oslo_concurrency.processutils [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73072) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:33:51 devstack cinder-volume[73072]: DEBUG cinder.manager [None req-2e763ba3-cd6f-4731-b48c-d335a7d69e6a None None] Notifying Schedulers of capabilities ... {{(pid=73072) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:33:53 devstack cinder-volume[72934]: INFO oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Caught SIGTERM, stopping children
Apr 20 23:33:53 devstack cinder-volume[72934]: DEBUG oslo_concurrency.lockutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Acquiring lock "singleton_lock" {{(pid=72934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:33:53 devstack cinder-volume[72934]: DEBUG oslo_concurrency.lockutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Acquired lock "singleton_lock" {{(pid=72934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:33:53 devstack cinder-volume[72934]: DEBUG oslo_concurrency.lockutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Releasing lock "singleton_lock" {{(pid=72934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:33:53 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Stop services. {{(pid=72934) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 20 23:33:53 devstack cinder-volume[72934]: DEBUG oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Killing children. {{(pid=72934) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 20 23:33:53 devstack cinder-volume[72934]: INFO oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Waiting on 1 children to exit
Apr 20 23:33:57 devstack cinder-volume[73072]: DEBUG oslo_concurrency.lockutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Acquiring lock "singleton_lock" {{(pid=73072) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:33:57 devstack cinder-volume[73072]: DEBUG oslo_concurrency.lockutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Acquired lock "singleton_lock" {{(pid=73072) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:33:57 devstack cinder-volume[73072]: DEBUG oslo_concurrency.lockutils [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Releasing lock "singleton_lock" {{(pid=73072) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:33:57 devstack cinder-volume[73072]: WARNING amqp [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 23:33:57 devstack cinder-volume[73072]: WARNING amqp [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 23:33:57 devstack cinder-volume[72934]: INFO oslo_service.backend._eventlet.service [None req-f307c36a-f9c5-4aa0-aa63-7ba251284cd2 None None] Child 73072 exited with status 0
Apr 20 23:33:57 devstack cinder-volume[82136]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 23:33:57 devstack cinder-volume[82136]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 23:33:57 devstack cinder-volume[82136]: we strongly recommend against using it for new projects.
Apr 20 23:33:57 devstack cinder-volume[82136]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 23:33:57 devstack cinder-volume[82136]: framework.  For more detail see
Apr 20 23:33:57 devstack cinder-volume[82136]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 23:33:57 devstack cinder-volume[82136]:   import eventlet  # noqa
Apr 20 23:33:59 devstack cinder-volume[82136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:33:59 devstack cinder-volume[82136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:33:59 devstack cinder-volume[82136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:33:59 devstack cinder-volume[82136]: INFO dbcounter [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Registered counter for database cinder
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82136) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG dbcounter [-] [82136] Writer thread running {{(pid=82136) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 23:34:00 devstack cinder-volume[82136]: INFO cinder.rpc [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 23:34:00 devstack cinder-volume[82136]: INFO cinder.rpc [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82136) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:00 devstack cinder-volume[82136]: INFO cinder.volume.manager [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Determined volume DB was empty at startup.
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG cinder.volume.manager [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82136) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 23:34:00 devstack cinder-volume[82136]: INFO cinder.volume.manager [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 20 23:34:00 devstack cinder-volume[82136]: WARNING stevedore.named [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 23:34:00 devstack cinder-volume[82136]: WARNING castellan.key_manager [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:34:00 devstack cinder-volume[82136]: WARNING cinder.keymgr.conf_key_mgr [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:34:00 devstack cinder-volume[82136]: INFO cinder.volume.manager [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82136) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:00 devstack cinder-volume[82136]: INFO oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Starting 1 workers
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Started child 82257 {{(pid=82136) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Full set of CONF: {{(pid=82136) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] ******************************************************************************** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Configuration options gathered from: {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] ================================================================================ {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 23:34:00 devstack cinder-volume[82257]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] allow_availability_zone_fallback = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] allow_compression_on_image_upload = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] allowed_direct_url_schemes     = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] api_rate_limit                 = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] auth_strategy                  = keystone {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_availability_zone      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_host                   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_name                   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_stats_polling_interval = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backup_api_class               = cinder.backup.api.API {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backup_name_template           = backup-%s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backup_use_same_host           = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backup_use_temp_snapshot       = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] chap_password                  = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] chap_username                  =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_internal_tenant_project_id = cd6ca1072cfd4225aab446ba43bbb18a {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_internal_tenant_user_id = e9fcdbbb82654964b697e8fa9116d846 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cluster                        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] compression_format             = gzip {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] compute_api_class              = cinder.compute.nova.API {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] config_dir                     = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] config_source                  = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] control_exchange               = openstack {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] debug                          = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] default_availability_zone      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] default_group_type             = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] default_volume_type            = QuobyteHD {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] disk_geometry                  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] driver_client_cert             = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] driver_client_cert_key         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] driver_data_namespace          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] driver_ssl_cert_path           = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] driver_ssl_cert_verify         = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] driver_use_ssl                 = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] enable_new_services            = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] enable_unsupported_driver      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] enabled_backends               = ['QuobyteHD'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] enforce_multipath_for_image_xfer = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] filter_function                = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_api_insecure            = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_api_ssl_compression     = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_ca_certificates_file    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_catalog_info            = image:glance:publicURL {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_certfile                = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_keyfile                 = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_num_retries             = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance_request_timeout         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] goodness_function              = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] graceful_shutdown_timeout      = 5 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] group_api_class                = cinder.group.api.API {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] host                           = devstack {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_compress_on_upload       = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_conversion_address_space_limit = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_conversion_cpu_limit     = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_conversion_disable       = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_upload_use_cinder_backend = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_upload_use_internal_tenant = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_volume_cache_enabled     = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_volume_cache_max_count   = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] image_volume_cache_max_size_gb = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] init_host_max_objects_retrieval = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] instance_format                = [instance: %(uuid)s]  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82257]: INFO cinder.volume.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] iscsi_target_flags             =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.remotefs [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82257) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] iscsi_write_cache              = on {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] iser_helper                    = tgtadm {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] iser_ip_address                = 192.168.122.185 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] iser_port                      = 3260 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_color                      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_config_append              = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_dir                        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_file                       = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_options                    = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_rotate_interval            = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_rotate_interval_type       = days {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] log_rotation_type              = none {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] max_age                        = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] max_logfile_count              = 30 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] max_logfile_size_mb            = 200 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] max_over_subscription_ratio    = 20.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] message_reap_interval          = 86400 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] message_ttl                    = 2592000 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] migration_create_volume_timeout_secs = 300 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] monkey_patch                   = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] monkey_patch_modules           = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] my_ip                          = 192.168.122.185 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] no_snapshot_gb_quota           = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] num_iser_scan_tries            = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] num_shell_tries                = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] num_volume_device_scan_tries   = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] nvmeof_conn_info_version       = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] nvmet_ns_id                    = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] nvmet_port_id                  = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_max_limit                = 1000 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_volume_ext_list          = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_volume_listen_port       = 8776 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_volume_use_ssl           = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] osapi_volume_workers           = 2 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] per_volume_size_limit          = -1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] periodic_fuzzy_delay           = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] periodic_interval              = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] public_endpoint                = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] publish_errors                 = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_backup_gigabytes         = 1000 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_backups                  = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_gigabytes                = 1000 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_groups                   = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_snapshots                = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] quota_volumes                  = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] rate_limit_burst               = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] rate_limit_except_level        = CRITICAL {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] rate_limit_interval            = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] reinit_driver_count            = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] replication_device             = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] report_discard_supported       = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] report_interval                = 120 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] reservation_clean_interval     = 86400 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] reservation_expire             = 86400 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] reserved_image_namespaces      = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] reserved_percentage            = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] rpc_response_timeout           = 120 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] run_external_periodic_tasks    = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] scst_target_driver             = iscsi {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] scst_target_iqn_name           = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_down_time              = 720 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] shell_completion               = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] snapshot_name_template         = snapshot-%s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] split_loggers                  = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] state_path                     = /opt/stack/data/cinder {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] storage_availability_zone      = nova {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] storage_protocol               = iSCSI {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] syslog_log_facility            = LOG_USER {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] target_helper                  = lioadm {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] target_ip_address              = 192.168.122.185 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] target_port                    = 3260 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] target_protocol                = iscsi {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] target_secondary_ip_addresses  = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] trace_flags                    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] transport_url                  = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] until_refresh                  = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_chap_auth                  = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_default_quota_class        = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_journal                    = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_json                       = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_multipath_for_image_xfer   = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_stderr                     = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] use_syslog                     = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] verify_glance_signatures       = enabled {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_api_class               = cinder.volume.api.API {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_backend_name            = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_clear                   = zero {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_clear_ionice            = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_clear_size              = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_copy_bps_limit          = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_dd_blocksize            = 1M {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_name_template           = volume-%s {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_service_inithost_offload = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volume_usage_audit_period      = month {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] zoning_mode                    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_concurrency.disable_process_locking = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.admin_password = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.admin_token = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.admin_user  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_port   = 35357 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_protocol = https {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_section = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_type   = password {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_uri    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.auth_version = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.cache       = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.certfile    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.identity_uri = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.include_service_catalog = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.insecure    = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.interface   = public {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.keyfile     = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_password =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82257) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcache_username =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.region_name = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82257]: WARNING cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82257]: WARNING cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.service_type = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.backend                  = dogpile.cache.null {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Running cmd (subprocess): mount.quobyte {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.backend_argument         = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.backend_expiration_time  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.config_prefix            = cache.oslo {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.debug_cache_backend      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.enable_retry_client      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.enable_socket_keepalive  = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.enabled                  = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.enforce_fips_mode        = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.expiration_time          = 600 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.hashclient_retry_attempts = 2 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_dead_retry      = 300 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_pool_maxsize    = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_sasl_enabled    = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.password                 = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.proxies                  = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.redis_db                 = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.redis_server             = localhost:6379 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.retry_attempts           = 2 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.retry_delay              = 0.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.socket_keepalive_count   = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.socket_keepalive_idle    = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.socket_keepalive_interval = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.socket_timeout           = 1.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.tls_allowed_ciphers      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.tls_cafile               = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.tls_certfile             = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.tls_enabled              = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.tls_keyfile              = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cache.username                 = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] coordination.backend_url       = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.asyncio_connection    = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.asyncio_slave_connection = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.backend               = sqlalchemy {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.connection            = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.connection_debug      = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.connection_parameters =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.connection_recycle_time = 3600 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.connection_trace      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.db_inc_retry_interval = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.db_max_retries        = 20 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.db_max_retry_interval = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.db_retry_interval     = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.max_overflow          = 50 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.max_pool_size         = 5 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.max_retries           = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.mysql_wsrep_sync_wait = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.pool_timeout          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.retry_interval        = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.slave_connection      = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.sqlite_synchronous    = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.synchronous_reader    = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] database.use_db_reconnect      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.connection_string     = messaging:// {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.enabled               = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.es_doc_type           = notification {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.es_scroll_size        = 10000 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.es_scroll_time        = 2m {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.filter_error_trace    = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.hmac_keys             = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.sentinel_service_name = mymaster {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.socket_timeout        = 0.1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.trace_requests        = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler.trace_sqlalchemy      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler_jaeger.process_tags   = {} {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler_jaeger.service_name_prefix = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] profiler_otlp.service_name_prefix = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.enforce_new_defaults = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: WARNING oslo_config.cfg [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.enforce_scope      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.policy_default_rule = default {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.policy_file        = policy.yaml {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.group          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.helper_command = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] privsep_osbrick.user           = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.group         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.helper_command = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] cinder_sys_admin.user          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.auth_section      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.auth_type         = password {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.cafile            = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.certfile          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.collect_timing    = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.insecure          = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.keyfile           = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.send_service_user_token = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.split_loggers     = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] service_user.timeout           = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.auth_section            = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.auth_type               = password {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.certfile                = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.collect_timing          = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.insecure                = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.keyfile                 = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.region_name             = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.split_loggers           = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] glance.timeout                 = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.backend_availability_zone = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.chap_password = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.chap_username =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.disk_geometry = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.driver_client_cert = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.driver_client_cert_key = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.driver_data_namespace = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.driver_use_ssl = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.extra_capabilities = {} {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.filter_function = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.goodness_function = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.iscsi_target_flags =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.iscsi_write_cache = on {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.iser_helper   = tgtadm {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.iser_port     = 3260 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_host      =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_login     = admin {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_mount_options = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_password  = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_private_key =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_share_path =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.num_shell_tries = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.quobyte_volume_url = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.replication_device = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.report_discard_supported = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.reserved_percentage = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.target_helper = tgtadm {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.target_port   = 3260 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.target_protocol = iscsi {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.trace_flags   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.unique_fqdn_network = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.use_chap_auth = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_backend_name = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_clear  = zero {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_clear_ionice = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_clear_size = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_reports.file_event_handler = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_reports.log_dir           = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.backend_availability_zone = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.backend_host         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.chap_password        = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.chap_username        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.chiscsi_conf         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.disk_geometry        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.driver_client_cert   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.driver_data_namespace = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.driver_use_ssl       = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.extra_capabilities   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.filter_function      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.goodness_function    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.iser_helper          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.iser_ip_address      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.iser_port            = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.iser_target_prefix   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_host             = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_login            = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_mount_options    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_password         = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_private_key      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_share_path       = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_ssh_port         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.num_shell_tries      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.nvmet_port_id        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.replication_device   = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.report_discard_supported = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.reserved_percentage  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.scst_target_driver   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.storage_protocol     = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.target_helper        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.target_ip_address    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.target_port          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.target_prefix        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.target_protocol      = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.trace_flags          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.use_chap_auth        = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_clear         = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_clear_size    = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] QuobyteHD.volumes_dir          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.ssl      = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_notifications.driver = [] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_notifications.retry = -1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] key_manager.fixed_key          = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.barbican_api_version  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.barbican_endpoint     = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.barbican_endpoint_type = public {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.barbican_region_name  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.cafile                = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.certfile              = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.collect_timing        = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.insecure              = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.keyfile               = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.number_of_retries     = 60 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.retry_delay           = 1 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.send_service_user_token = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.split_loggers         = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.timeout               = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.verify_ssl            = True {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican.verify_ssl_path       = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.auth_section = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.auth_type = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.cafile   = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.certfile = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.collect_timing = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.insecure = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.keyfile  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.split_loggers = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] barbican_service_user.timeout  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.approle_role_id          = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.approle_secret_id        = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.kv_mountpoint            = secret {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.kv_path                  = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.kv_version               = 2 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.namespace                = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.root_token_id            = **** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.ssl_ca_crt_file          = None {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.timeout                  = 60.0 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.use_ssl                  = False {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:00 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] ******************************************************************************** {{(pid=82136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 23:34:00 devstack quobyte-client[82258]: Reading configuration file: /etc/quobyte/client.cfg
Apr 20 23:34:00 devstack quobyte-client[82258]: Invalid parameters found, error: missing mount point.
Apr 20 23:34:00 devstack quobyte-client[82258]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 20 23:34:00 devstack quobyte-client[82258]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:34:00 devstack cinder-volume[82257]: INFO cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b ...
Apr 20 23:34:00 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 -c /etc/quobyte/client-cinder.cfg {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:00 devstack sudo[82259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 -c /etc/quobyte/client-cinder.cfg
Apr 20 23:34:00 devstack sudo[82259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:01 devstack sudo[82259]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.513s {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:01 devstack cinder-volume[82257]: INFO cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b succeeded
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.520s {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:01 devstack sudo[82328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:34:01 devstack sudo[82328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:01 devstack sudo[82328]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.401s {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:01 devstack cinder-volume[82257]: INFO cinder.volume.driver [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.volume.driver [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82257) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_db.sqlalchemy.engines [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82257) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG dbcounter [-] [82257] Writer thread running {{(pid=82257) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.db.sqlalchemy.api [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Building query based on filter {{(pid=82257) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.image.image_utils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82257) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 23:34:01 devstack cinder-volume[82257]: INFO cinder.keymgr.migration [None req-fe21c6ed-6a37-46f9-b9c2-344ec18d5856 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:01 devstack sudo[82331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:34:01 devstack sudo[82331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:01 devstack sudo[82331]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.392s {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:01 devstack cinder-volume[82257]: DEBUG cinder.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Notifying Schedulers of capabilities ... {{(pid=82257) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:34:01 devstack cinder-volume[82257]: INFO cinder.volume.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Driver initialization completed successfully.
Apr 20 23:34:01 devstack cinder-volume[82257]: INFO cinder.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Initiating service 3 cleanup
Apr 20 23:34:02 devstack cinder-volume[82257]: INFO cinder.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Service 3 cleanup completed.
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG cinder.service [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Creating RPC server for service cinder-volume {{(pid=82257) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG cinder.service [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82257) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 23:34:02 devstack cinder-volume[82257]: INFO cinder.volume.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82257) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG cinder.volume.drivers.quobyte [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82257) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:02 devstack sudo[82336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:34:02 devstack sudo[82336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:02 devstack sudo[82336]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:02 devstack cinder-volume[82257]: DEBUG oslo_concurrency.processutils [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.423s {{(pid=82257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:02 devstack cinder-volume[82257]: INFO cinder.volume.manager [None req-a672b3a2-48aa-4124-8a0f-4d887bd7fa53 None None] Driver post RPC initialization completed successfully.
Apr 20 23:34:04 devstack cinder-volume[82136]: INFO oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Caught SIGTERM, stopping children
Apr 20 23:34:04 devstack cinder-volume[82136]: DEBUG oslo_concurrency.lockutils [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Acquiring lock "singleton_lock" {{(pid=82136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:34:04 devstack cinder-volume[82136]: DEBUG oslo_concurrency.lockutils [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Acquired lock "singleton_lock" {{(pid=82136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:34:04 devstack cinder-volume[82136]: DEBUG oslo_concurrency.lockutils [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Releasing lock "singleton_lock" {{(pid=82136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:34:04 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Stop services. {{(pid=82136) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 20 23:34:04 devstack cinder-volume[82136]: DEBUG oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Killing children. {{(pid=82136) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 20 23:34:04 devstack cinder-volume[82136]: INFO oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Waiting on 1 children to exit
Apr 20 23:34:06 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Acquiring lock "singleton_lock" {{(pid=82257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:34:06 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Acquired lock "singleton_lock" {{(pid=82257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:34:06 devstack cinder-volume[82257]: DEBUG oslo_concurrency.lockutils [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Releasing lock "singleton_lock" {{(pid=82257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:34:06 devstack cinder-volume[82257]: WARNING amqp [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 23:34:06 devstack cinder-volume[82257]: WARNING amqp [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 23:34:06 devstack cinder-volume[82136]: INFO oslo_service.backend._eventlet.service [None req-7e8ce80f-8722-4156-9518-86ca55a77b4a None None] Child 82257 exited with status 0
Apr 20 23:34:06 devstack cinder-volume[82476]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 23:34:06 devstack cinder-volume[82476]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 23:34:06 devstack cinder-volume[82476]: we strongly recommend against using it for new projects.
Apr 20 23:34:06 devstack cinder-volume[82476]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 23:34:06 devstack cinder-volume[82476]: framework.  For more detail see
Apr 20 23:34:06 devstack cinder-volume[82476]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 23:34:06 devstack cinder-volume[82476]:   import eventlet  # noqa
Apr 20 23:34:08 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 23:34:08 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 23:34:08 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 23:34:08 devstack cinder-volume[82476]: INFO dbcounter [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Registered counter for database cinder
Apr 20 23:34:08 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:08 devstack cinder-volume[82476]: DEBUG dbcounter [-] [82476] Writer thread running {{(pid=82476) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 23:34:08 devstack cinder-volume[82476]: INFO cinder.rpc [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 23:34:08 devstack cinder-volume[82476]: INFO cinder.rpc [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 23:34:08 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:09 devstack cinder-volume[82476]: INFO cinder.volume.manager [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Determined volume DB was empty at startup.
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG cinder.volume.manager [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82476) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 23:34:09 devstack cinder-volume[82476]: WARNING stevedore.named [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 23:34:09 devstack cinder-volume[82476]: WARNING castellan.key_manager [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:34:09 devstack cinder-volume[82476]: WARNING cinder.keymgr.conf_key_mgr [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 23:34:09 devstack cinder-volume[82476]: INFO cinder.volume.manager [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:09 devstack cinder-volume[82476]: INFO oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Starting 1 workers
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Started child 82641 {{(pid=82476) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Full set of CONF: {{(pid=82476) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] ******************************************************************************** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Configuration options gathered from: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] ================================================================================ {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] allow_availability_zone_fallback = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] allow_compression_on_image_upload = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] allowed_direct_url_schemes     = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] api_rate_limit                 = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] auth_strategy                  = keystone {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_availability_zone      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_host                   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_name                   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_stats_polling_interval = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backup_api_class               = cinder.backup.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backup_name_template           = backup-%s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backup_use_same_host           = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backup_use_temp_snapshot       = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] chap_password                  = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] chap_username                  =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_internal_tenant_project_id = cd6ca1072cfd4225aab446ba43bbb18a {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_internal_tenant_user_id = e9fcdbbb82654964b697e8fa9116d846 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cluster                        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] compression_format             = gzip {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] compute_api_class              = cinder.compute.nova.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] config_dir                     = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] config_source                  = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] control_exchange               = openstack {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] debug                          = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] default_availability_zone      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] default_group_type             = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82641]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] default_volume_type            = QuobyteHD {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] disk_geometry                  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] driver_client_cert             = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] driver_client_cert_key         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] driver_data_namespace          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] driver_ssl_cert_path           = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] driver_ssl_cert_verify         = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] driver_use_ssl                 = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] enable_new_services            = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] enable_unsupported_driver      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] enabled_backends               = ['QuobyteHD'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] enforce_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] filter_function                = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_api_insecure            = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_api_ssl_compression     = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_ca_certificates_file    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_catalog_info            = image:glance:publicURL {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_certfile                = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_keyfile                 = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_num_retries             = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance_request_timeout         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] goodness_function              = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] graceful_shutdown_timeout      = 5 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] group_api_class                = cinder.group.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] host                           = devstack {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_compress_on_upload       = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_conversion_address_space_limit = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_conversion_cpu_limit     = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_conversion_disable       = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_upload_use_cinder_backend = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_upload_use_internal_tenant = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_volume_cache_enabled     = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_volume_cache_max_count   = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] image_volume_cache_max_size_gb = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] init_host_max_objects_retrieval = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] instance_format                = [instance: %(uuid)s]  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] iscsi_target_flags             =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] iscsi_write_cache              = on {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] iser_helper                    = tgtadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] iser_ip_address                = 192.168.122.185 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] iser_port                      = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_color                      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_config_append              = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_dir                        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_file                       = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_options                    = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_rotate_interval            = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_rotate_interval_type       = days {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] log_rotation_type              = none {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] max_age                        = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] max_logfile_count              = 30 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] max_logfile_size_mb            = 200 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] max_over_subscription_ratio    = 20.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] message_reap_interval          = 86400 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] message_ttl                    = 2592000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] migration_create_volume_timeout_secs = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] monkey_patch                   = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] monkey_patch_modules           = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] my_ip                          = 192.168.122.185 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] no_snapshot_gb_quota           = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] num_iser_scan_tries            = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] num_shell_tries                = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] num_volume_device_scan_tries   = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] nvmeof_conn_info_version       = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] nvmet_ns_id                    = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] nvmet_port_id                  = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_max_limit                = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_volume_ext_list          = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_volume_listen_port       = 8776 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_volume_use_ssl           = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] osapi_volume_workers           = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] per_volume_size_limit          = -1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] periodic_fuzzy_delay           = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] periodic_interval              = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] public_endpoint                = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] publish_errors                 = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_backup_gigabytes         = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_backups                  = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_gigabytes                = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_groups                   = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_snapshots                = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] quota_volumes                  = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] rate_limit_burst               = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] rate_limit_except_level        = CRITICAL {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] rate_limit_interval            = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] reinit_driver_count            = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] replication_device             = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] report_discard_supported       = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82641) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] report_interval                = 120 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] reservation_clean_interval     = 86400 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] reservation_expire             = 86400 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] reserved_image_namespaces      = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] reserved_percentage            = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] rpc_response_timeout           = 120 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] run_external_periodic_tasks    = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] scst_target_driver             = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] scst_target_iqn_name           = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_down_time              = 720 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] shell_completion               = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] snapshot_name_template         = snapshot-%s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] split_loggers                  = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] state_path                     = /opt/stack/data/cinder {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] storage_availability_zone      = nova {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] storage_protocol               = iSCSI {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] syslog_log_facility            = LOG_USER {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] target_helper                  = lioadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] target_ip_address              = 192.168.122.185 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] target_port                    = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] target_protocol                = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] target_secondary_ip_addresses  = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] trace_flags                    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] transport_url                  = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] until_refresh                  = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_chap_auth                  = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_default_quota_class        = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_journal                    = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_json                       = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_multipath_for_image_xfer   = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_stderr                     = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] use_syslog                     = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] verify_glance_signatures       = enabled {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_api_class               = cinder.volume.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_backend_name            = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_clear                   = zero {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_clear_ionice            = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_clear_size              = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_copy_bps_limit          = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_dd_blocksize            = 1M {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_name_template           = volume-%s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_service_inithost_offload = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volume_usage_audit_period      = month {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] zoning_mode                    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_concurrency.disable_process_locking = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.admin_password = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.admin_token = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.admin_user  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_port   = 35357 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_protocol = https {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_section = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_type   = password {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_uri    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.auth_version = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.cache       = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.certfile    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.identity_uri = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.include_service_catalog = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.insecure    = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.interface   = public {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.keyfile     = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_password =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcache_username =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.region_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.service_token_roles_required = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.service_type = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.backend                  = dogpile.cache.null {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.backend_argument         = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.backend_expiration_time  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.config_prefix            = cache.oslo {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.debug_cache_backend      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.enable_retry_client      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.enable_socket_keepalive  = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.enabled                  = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.enforce_fips_mode        = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.expiration_time          = 600 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.hashclient_retry_attempts = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_dead_retry      = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82641) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 20 23:34:09 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 20 23:34:09 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_pool_maxsize    = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_sasl_enabled    = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.password                 = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Running cmd (subprocess): mount.quobyte {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.proxies                  = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.redis_db                 = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.redis_server             = localhost:6379 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.retry_attempts           = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.retry_delay              = 0.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.socket_keepalive_count   = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.socket_keepalive_idle    = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.socket_keepalive_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.socket_timeout           = 1.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.tls_allowed_ciphers      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.tls_cafile               = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.tls_certfile             = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.tls_enabled              = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.tls_keyfile              = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cache.username                 = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] coordination.backend_url       = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.asyncio_connection    = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.asyncio_slave_connection = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.backend               = sqlalchemy {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.connection            = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.connection_debug      = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.connection_parameters =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.connection_recycle_time = 3600 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.connection_trace      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.db_inc_retry_interval = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.db_max_retries        = 20 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.db_max_retry_interval = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.db_retry_interval     = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.max_overflow          = 50 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.max_pool_size         = 5 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.max_retries           = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.mysql_wsrep_sync_wait = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.pool_timeout          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.retry_interval        = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.slave_connection      = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.sqlite_synchronous    = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.synchronous_reader    = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] database.use_db_reconnect      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.connection_string     = messaging:// {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.enabled               = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.es_doc_type           = notification {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.es_scroll_size        = 10000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.es_scroll_time        = 2m {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.filter_error_trace    = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.hmac_keys             = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.sentinel_service_name = mymaster {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.socket_timeout        = 0.1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.trace_requests        = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler.trace_sqlalchemy      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler_jaeger.process_tags   = {} {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler_jaeger.service_name_prefix = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] profiler_otlp.service_name_prefix = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.enforce_new_defaults = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: WARNING oslo_config.cfg [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.enforce_scope      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.policy_default_rule = default {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.policy_file        = policy.yaml {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.group          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.helper_command = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] privsep_osbrick.user           = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.group         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.helper_command = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] cinder_sys_admin.user          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.auth_section      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.auth_type         = password {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.cafile            = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack quobyte-client[82681]: Reading configuration file: /etc/quobyte/client.cfg
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.certfile          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.collect_timing    = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.insecure          = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.keyfile           = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.send_service_user_token = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.split_loggers     = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] service_user.timeout           = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack quobyte-client[82681]: Invalid parameters found, error: missing mount point.
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.auth_section            = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.auth_type               = password {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.certfile                = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.collect_timing          = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.insecure                = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.keyfile                 = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack quobyte-client[82681]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.region_name             = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.split_loggers           = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] glance.timeout                 = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.backend_availability_zone = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack quobyte-client[82681]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.chap_password = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.chap_username =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.disk_geometry = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.driver_client_cert = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.driver_client_cert_key = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.driver_data_namespace = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.driver_use_ssl = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.extra_capabilities = {} {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.filter_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.goodness_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.iscsi_target_flags =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.iscsi_write_cache = on {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.iser_helper   = tgtadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.iser_port     = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_host      =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_login     = admin {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_mount_options = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_password  = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_private_key =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_share_path =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.num_shell_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_client_cfg = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.quobyte_volume_url = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.replication_device = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.report_discard_supported = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.reserved_percentage = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack sudo[82682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.target_helper = tgtadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.target_port   = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.target_protocol = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack sudo[82682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.trace_flags   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.unique_fqdn_network = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.use_chap_auth = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_backend_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_clear  = zero {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_clear_ionice = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_clear_size = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_reports.file_event_handler = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_reports.log_dir           = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.backend_availability_zone = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.backend_host         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.chap_password        = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.chap_username        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.chiscsi_conf         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.disk_geometry        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.driver_client_cert   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.driver_client_cert_key = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.driver_data_namespace = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.driver_use_ssl       = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.extra_capabilities   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.filter_function      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.goodness_function    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.iser_helper          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.iser_ip_address      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.iser_port            = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.iser_target_prefix   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_host             = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_login            = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_mount_options    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_password         = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_private_key      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_share_path       = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_ssh_port         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.num_shell_tries      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.nvmet_port_id        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.replication_device   = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.report_discard_supported = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.reserved_percentage  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.scst_target_driver   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.storage_protocol     = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.target_helper        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.target_ip_address    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.target_port          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.target_prefix        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.target_protocol      = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.trace_flags          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.use_chap_auth        = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_clear         = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_clear_size    = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] QuobyteHD.volumes_dir          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.ssl      = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_notifications.driver = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_notifications.retry = -1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] key_manager.fixed_key          = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.barbican_api_version  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.barbican_endpoint     = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.barbican_endpoint_type = public {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.barbican_region_name  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.cafile                = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.certfile              = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.collect_timing        = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.insecure              = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.keyfile               = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.number_of_retries     = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.retry_delay           = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.send_service_user_token = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.split_loggers         = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.timeout               = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.verify_ssl            = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican.verify_ssl_path       = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.auth_section = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.auth_type = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.cafile   = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.collect_timing = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.keyfile  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.split_loggers = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] barbican_service_user.timeout  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.approle_role_id          = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.approle_secret_id        = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.kv_mountpoint            = secret {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.kv_path                  = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.kv_version               = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.namespace                = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.root_token_id            = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.ssl_ca_crt_file          = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.timeout                  = 60.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.use_ssl                  = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 23:34:09 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-b883e7e2-63e6-4a2d-bc32-1420adae4a2e None None] ******************************************************************************** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 23:34:09 devstack sudo[82682]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:09 devstack cinder-volume[82641]: INFO cinder.volume.driver [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.driver [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82641) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_db.sqlalchemy.engines [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writer thread running {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.db.sqlalchemy.api [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Building query based on filter {{(pid=82641) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82641) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:34:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:09 devstack cinder-volume[82641]: INFO cinder.keymgr.migration [None req-1a3d9a86-6486-443a-b2de-d90caebb202f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 23:34:09 devstack sudo[82709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:34:09 devstack sudo[82709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:10 devstack sudo[82709]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:34:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Driver initialization completed successfully.
Apr 20 23:34:10 devstack cinder-volume[82641]: INFO cinder.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Initiating service 3 cleanup
Apr 20 23:34:10 devstack cinder-volume[82641]: INFO cinder.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Service 3 cleanup completed.
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG cinder.service [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Creating RPC server for service cinder-volume {{(pid=82641) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG cinder.service [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82641) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 23:34:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:34:10 devstack sudo[82720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:34:10 devstack sudo[82720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:34:10 devstack sudo[82720]: pam_unix(sudo:session): session closed for user root
Apr 20 23:34:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:34:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3b8ea830-83c6-4ae8-a689-f680a3acbfbd None None] Driver post RPC initialization completed successfully.
Apr 20 23:34:19 devstack cinder-volume[82476]: DEBUG dbcounter [-] [82476] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82476) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:34:20 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:34:20 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=2 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Flow 'volume_create_manager' (c7bb9952-40ad-43af-b8de-9c4c4d4d9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a94989d-7ca5-487b-9360-cf7a3611cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a94989d-7ca5-487b-9360-cf7a3611cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-570261279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54bf5d6-3e48-401e-8111-fdf10b670271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25df12cca78a4bcd8718e71a7525d06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:09Z,use_quota=True,user_id='117e64e9f19d4936a2d65e866079ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf4a5da-7a37-469b-98d1-dc80927283da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf4a5da-7a37-469b-98d1-dc80927283da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db49d7f2-05d9-424d-81af-78a35284af59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db49d7f2-05d9-424d-81af-78a35284af59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54bf5d6-3e48-401e-8111-fdf10b670271', 'volume_name': 'volume-b54bf5d6-3e48-401e-8111-fdf10b670271', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634ab003-33d2-465e-8bd0-26a7ac3c9e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634ab003-33d2-465e-8bd0-26a7ac3c9e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2546f5-6e39-4148-996f-5a9f09f8ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Volume b54bf5d6-3e48-401e-8111-fdf10b670271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54bf5d6-3e48-401e-8111-fdf10b670271', 'volume_size': 1}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-570261279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54bf5d6-3e48-401e-8111-fdf10b670271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25df12cca78a4bcd8718e71a7525d06e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:09Z,use_quota=True,user_id='117e64e9f19d4936a2d65e866079ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Creating volume b54bf5d6-3e48-401e-8111-fdf10b670271 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:35:09 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:35:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:09 devstack sudo[83185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 1073741824
Apr 20 23:35:09 devstack sudo[83185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:11 devstack sudo[83185]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 1073741824" returned: 0 in 2.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:11 devstack sudo[83541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271
Apr 20 23:35:11 devstack sudo[83541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:13 devstack sudo[83541]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271" returned: 0 in 1.289s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] <== create_volume: return (3935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.940s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2546f5-6e39-4148-996f-5a9f09f8ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54bf5d6-3e48-401e-8111-fdf10b670271', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630244e6-6394-4dae-a850-75d11724a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Volume volume-b54bf5d6-3e48-401e-8111-fdf10b670271 (b54bf5d6-3e48-401e-8111-fdf10b670271): created successfully
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630244e6-6394-4dae-a850-75d11724a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Flow 'volume_create_manager' (c7bb9952-40ad-43af-b8de-9c4c4d4d9580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2bfb58f3-0a51-4036-8c66-7e390e086b80 tempest-DeleteServersTestJSON-1192152363 None] Created volume successfully.
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Flow 'volume_create_manager' (4a7a9335-28c6-4e3d-9f4a-3f645067172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b002b82f-4f55-4b4f-80bb-90a1172b9728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b002b82f-4f55-4b4f-80bb-90a1172b9728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-840955066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f96c8c-0d6a-49e6-a22d-378fd78825b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889248714c414320b731cdebf5ade3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:14Z,use_quota=True,user_id='25a2d6402bc24dd694ed6b8d4f6e6807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bb25ea-32a0-4669-9e42-a2b8a57e5171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bb25ea-32a0-4669-9e42-a2b8a57e5171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afdeefd-eff1-4aef-8e3c-2bef0133f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afdeefd-eff1-4aef-8e3c-2bef0133f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f96c8c-0d6a-49e6-a22d-378fd78825b3', 'volume_name': 'volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfde0e3-0891-41a1-9664-2ef528f7662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfde0e3-0891-41a1-9664-2ef528f7662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7d2a8c-b84e-4944-8127-ac621212e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Volume c7f96c8c-0d6a-49e6-a22d-378fd78825b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3', 'volume_size': 1}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-840955066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f96c8c-0d6a-49e6-a22d-378fd78825b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='889248714c414320b731cdebf5ade3f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:14Z,use_quota=True,user_id='25a2d6402bc24dd694ed6b8d4f6e6807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Creating volume c7f96c8c-0d6a-49e6-a22d-378fd78825b3 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:35:14 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:35:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:14 devstack sudo[83552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 1073741824
Apr 20 23:35:14 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:15 devstack sudo[83561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:35:15 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:16 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 1073741824" returned: 0 in 1.660s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:16 devstack sudo[83564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3
Apr 20 23:35:16 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:16 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 1.064s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:35:17 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3" returned: 0 in 1.357s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] <== create_volume: return (3162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.164s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7d2a8c-b84e-4944-8127-ac621212e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf321e0-b904-4c8f-ad82-3eebd24fdb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Volume volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 (c7f96c8c-0d6a-49e6-a22d-378fd78825b3): created successfully
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf321e0-b904-4c8f-ad82-3eebd24fdb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Flow 'volume_create_manager' (4a7a9335-28c6-4e3d-9f4a-3f645067172e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-35980250-aa7a-4e7e-a675-e17b70530129 tempest-VolumesAdminNegativeTest-1688170443 None] Created volume successfully.
Apr 20 23:35:19 devstack cinder-volume[82641]: WARNING py.warnings [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 20 23:35:19 devstack cinder-volume[82641]:   .first()
Apr 20 23:35:19 devstack cinder-volume[82641]: 
Apr 20 23:35:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:19 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3ra3fnfu/privsep.sock']
Apr 20 23:35:19 devstack sudo[83594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3ra3fnfu/privsep.sock
Apr 20 23:35:19 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Acquiring lock "cinder-c7f96c8c-0d6a-49e6-a22d-378fd78825b3-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:35:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "cinder-c7f96c8c-0d6a-49e6-a22d-378fd78825b3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:35:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Acquiring lock "cinder-quobyte-c7f96c8c-0d6a-49e6-a22d-378fd78825b3" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:35:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "cinder-quobyte-c7f96c8c-0d6a-49e6-a22d-378fd78825b3" acquired by "delete_volume" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 23:35:20 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 23:35:21 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 20 23:35:22 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:22 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Spawned new privsep daemon via rootwrap
Apr 20 23:35:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Accepted privsep connection to /tmp/tmp3ra3fnfu/privsep.sock {{(pid=82641) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 20 23:35:22 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 20 23:35:22 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 20 23:35:22 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 20 23:35:22 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83633
Apr 20 23:35:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe9562-6843-4e72-bcb3-cac7e941746d]: (2,) {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:35:22 devstack cinder-volume[82641]: WARNING oslo_privsep.priv_context [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] privsep daemon already running
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84796d5-867b-4e9f-bbee-eda6db89e79a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a4c8e6-0584-4239-ac0f-3dfe0e356a45]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:23 devstack sudo[83636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3
Apr 20 23:35:23 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:23 devstack sudo[83637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271
Apr 20 23:35:23 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Flow 'volume_create_manager' (0f0b8b73-6040-4566-8550-512011b3bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4ba4de-b433-4121-8537-1cf693d4b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4ba4de-b433-4121-8537-1cf693d4b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:23Z,deleted=False,deleted_at=None,display_description='',display_name='c76dd9d8-b7b5-4704-ab8d-d855e5b658c4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b95812e-91dd-4775-a149-ae188f280b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae28dd4284f3477299eacace86483065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:24Z,use_quota=True,user_id='1baf5117c7304087afa6f7cd9358af3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cdc6276-81fd-4331-b618-4fd8112af208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cdc6276-81fd-4331-b618-4fd8112af208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6562dbd0-20b0-4e60-91dd-dfbd9a9ba861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6562dbd0-20b0-4e60-91dd-dfbd9a9ba861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b95812e-91dd-4775-a149-ae188f280b00', 'volume_name': 'volume-3b95812e-91dd-4775-a149-ae188f280b00', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd5c4df-e092-4b3c-9d71-a8b0f1332694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd5c4df-e092-4b3c-9d71-a8b0f1332694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7852fef-e1c1-4035-ad6b-9ad565afc0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Volume 3b95812e-91dd-4775-a149-ae188f280b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b95812e-91dd-4775-a149-ae188f280b00', 'volume_size': 1}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:24 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3" returned: 0 in 1.055s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:24 devstack sudo[83646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3
Apr 20 23:35:24 devstack sudo[83646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:24 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c7f96c8c-0d6a-49e6-a22d-378fd78825b3" returned: 0 in 0.586s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:24 devstack sudo[83646]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271" returned: 0 in 1.648s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.916s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "cinder-quobyte-c7f96c8c-0d6a-49e6-a22d-378fd78825b3" released by "delete_volume" :: held 4.758s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:23Z,deleted=False,deleted_at=None,display_description='',display_name='c76dd9d8-b7b5-4704-ab8d-d855e5b658c4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b95812e-91dd-4775-a149-ae188f280b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae28dd4284f3477299eacace86483065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:24Z,use_quota=True,user_id='1baf5117c7304087afa6f7cd9358af3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Creating volume 3b95812e-91dd-4775-a149-ae188f280b00 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:35:24 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:24 devstack sudo[83653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 1073741824
Apr 20 23:35:24 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b', 'name': 'volume-b54bf5d6-3e48-401e-8111-fdf10b670271', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c9b5450-4df1-4637-8170-bd433e1b4fd3', 'enforce_multipath': True} {{(pid=82641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 23:35:25 devstack cinder-volume[82641]: WARNING cinder.quota [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:35:25 devstack cinder-volume[82641]: WARNING cinder.quota [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:35:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-fcb59ed8-4d48-4268-8af2-acd595044e3d req-55567362-6638-45c2-b8e4-1b8bc26f58d6 tempest-DeleteServersTestJSON-1192152363 None] attachment_update completed successfully.
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Created reservations ['586131eb-5ce0-4f27-9979-340a4acd7701', '5dcac840-6a24-4427-b0df-d84771b15326', '6b208ae1-181d-40c2-a5fd-198384cb130f', '34505fa2-9258-4108-b5f7-2265b27f5f70'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:25 devstack sudo[83659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:35:25 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:26 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 1073741824" returned: 0 in 1.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:26 devstack sudo[83664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00
Apr 20 23:35:26 devstack sudo[83664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:26 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 1.184s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:26 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:35:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Deleted volume successfully.
Apr 20 23:35:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-501bcebc-7f69-4c04-8763-f5972d4a9f08 tempest-VolumesAdminNegativeTest-1688170443 None] Lock "cinder-c7f96c8c-0d6a-49e6-a22d-378fd78825b3-delete_volume" released by "delete_volume" :: held 6.850s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:35:27 devstack sudo[83664]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00" returned: 0 in 1.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] <== create_volume: return (2950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.952s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7852fef-e1c1-4035-ad6b-9ad565afc0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b95812e-91dd-4775-a149-ae188f280b00', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a3b69f-8b70-4d14-bb52-e8de3d460046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Volume volume-3b95812e-91dd-4775-a149-ae188f280b00 (3b95812e-91dd-4775-a149-ae188f280b00): created successfully
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a3b69f-8b70-4d14-bb52-e8de3d460046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Flow 'volume_create_manager' (0f0b8b73-6040-4566-8550-512011b3bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-45ab86e3-5109-4cc2-ab49-f724c9e5475d tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Created volume successfully.
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4901daa4-f1c3-443f-9250-6a6ac02e6430]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:31 devstack sudo[84128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00
Apr 20 23:35:31 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:31 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00" returned: 0 in 0.744s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b', 'name': 'volume-3b95812e-91dd-4775-a149-ae188f280b00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9eddf62c-ccf6-40b3-93c7-6db7b389510c', 'enforce_multipath': True} {{(pid=82641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 23:35:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-2d93f992-9755-4890-a84d-e3da721a157b req-7d3fa08f-41dd-4ab5-8eb2-e6810d61019a tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] attachment_update completed successfully.
Apr 20 23:35:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-2c7b31d7-d5cc-490f-9c4a-33b456e6a807 req-c6d86993-d989-4505-96c7-4882fe10f096 tempest-DeleteServersTestJSON-1192152363 None] Terminate volume connection completed successfully.
Apr 20 23:35:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-2c7b31d7-d5cc-490f-9c4a-33b456e6a807 req-c6d86993-d989-4505-96c7-4882fe10f096 tempest-DeleteServersTestJSON-1192152363 None] Deleting attachment 5c9b5450-4df1-4637-8170-bd433e1b4fd3. {{(pid=82641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Acquiring lock "cinder-b54bf5d6-3e48-401e-8111-fdf10b670271-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Lock "cinder-b54bf5d6-3e48-401e-8111-fdf10b670271-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Acquiring lock "cinder-quobyte-b54bf5d6-3e48-401e-8111-fdf10b670271" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Lock "cinder-quobyte-b54bf5d6-3e48-401e-8111-fdf10b670271" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb05ba-580f-4649-83e3-ee54ff86df98]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:40 devstack sudo[84636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271
Apr 20 23:35:40 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:40 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271" returned: 0 in 0.619s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:40 devstack sudo[84643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271
Apr 20 23:35:40 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:41 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b54bf5d6-3e48-401e-8111-fdf10b670271" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Lock "cinder-quobyte-b54bf5d6-3e48-401e-8111-fdf10b670271" released by "delete_volume" :: held 1.093s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Created reservations ['564be198-dd24-4ccc-b3f5-46c25e17f99e', 'f2cb8894-e121-4355-90da-850b19835073', '26a3c54c-2f3d-41c6-9ea4-c88240edaeae', '7f81a62f-e3c7-4235-a6f8-ad1b76b5f3ca'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:41 devstack sudo[84646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:35:41 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:41 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:41 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:35:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Deleted volume successfully.
Apr 20 23:35:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fbdb4940-eced-4786-abd4-403b0cc05c0f tempest-DeleteServersTestJSON-1192152363 None] Lock "cinder-b54bf5d6-3e48-401e-8111-fdf10b670271-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=3 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Flow 'volume_create_manager' (4bbab025-4643-4c38-95a4-34d5ebeb8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d771d65-5dca-4115-a670-809511b8309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d771d65-5dca-4115-a670-809511b8309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550417969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699cb503-a589-4105-ad44-d12127bb868b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed67bbb7e874466b056d08e1f221b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:52Z,use_quota=True,user_id='8282571beaac40ceae09cb4138eca00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab8b8dc-98ea-4c6f-a45c-03c1ef6aa56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab8b8dc-98ea-4c6f-a45c-03c1ef6aa56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add679c5-9e1e-4d0a-82ca-12f0d05b02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add679c5-9e1e-4d0a-82ca-12f0d05b02cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699cb503-a589-4105-ad44-d12127bb868b', 'volume_name': 'volume-699cb503-a589-4105-ad44-d12127bb868b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc4703d-bb9a-4c98-b294-953f141ac3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc4703d-bb9a-4c98-b294-953f141ac3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf85fcf7-a6a4-44fd-8f65-135f3fa2abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Volume 699cb503-a589-4105-ad44-d12127bb868b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699cb503-a589-4105-ad44-d12127bb868b', 'volume_size': 1}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550417969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699cb503-a589-4105-ad44-d12127bb868b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed67bbb7e874466b056d08e1f221b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:52Z,use_quota=True,user_id='8282571beaac40ceae09cb4138eca00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Creating volume 699cb503-a589-4105-ad44-d12127bb868b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:35:51 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:35:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:51 devstack sudo[84779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b 1073741824
Apr 20 23:35:51 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:52 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b 1073741824" returned: 0 in 0.956s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:52 devstack sudo[84811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b
Apr 20 23:35:52 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:54 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b" returned: 0 in 1.266s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf85fcf7-a6a4-44fd-8f65-135f3fa2abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699cb503-a589-4105-ad44-d12127bb868b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebecdcd-813a-4355-811b-6805f4e6a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Volume volume-699cb503-a589-4105-ad44-d12127bb868b (699cb503-a589-4105-ad44-d12127bb868b): created successfully
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebecdcd-813a-4355-811b-6805f4e6a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Flow 'volume_create_manager' (4bbab025-4643-4c38-95a4-34d5ebeb8563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3ab79605-a6ba-4357-8c68-923253fc128a tempest-VolumesTestJSON-47893528 None] Created volume successfully.
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Flow 'volume_create_manager' (ad84c0f9-8124-4bc8-8aca-9eb94e44aa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ba50b8-6b06-4b84-9b3b-61bf5cde6773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ba50b8-6b06-4b84-9b3b-61bf5cde6773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-261470453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0b4d19-0a0c-444b-a162-357834dc5b26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed67bbb7e874466b056d08e1f221b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:56Z,use_quota=True,user_id='8282571beaac40ceae09cb4138eca00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eef6ab0-4809-4e9a-9356-ba6b36cac3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eef6ab0-4809-4e9a-9356-ba6b36cac3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba40604-a299-4d53-bd66-151d93b389cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba40604-a299-4d53-bd66-151d93b389cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0b4d19-0a0c-444b-a162-357834dc5b26', 'volume_name': 'volume-5d0b4d19-0a0c-444b-a162-357834dc5b26', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a65ace8-a4cd-4a75-b39b-1f563b7d4166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a65ace8-a4cd-4a75-b39b-1f563b7d4166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5844c58d-9efc-4c37-b234-2216849ba263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Volume 5d0b4d19-0a0c-444b-a162-357834dc5b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0b4d19-0a0c-444b-a162-357834dc5b26', 'volume_size': 1}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-261470453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0b4d19-0a0c-444b-a162-357834dc5b26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed67bbb7e874466b056d08e1f221b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:56Z,use_quota=True,user_id='8282571beaac40ceae09cb4138eca00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Creating volume 5d0b4d19-0a0c-444b-a162-357834dc5b26 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:35:55 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:35:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:56 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 1073741824
Apr 20 23:35:56 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:57 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 1073741824" returned: 0 in 1.141s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:57 devstack sudo[84879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26
Apr 20 23:35:57 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:35:58 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26" returned: 0 in 1.025s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5844c58d-9efc-4c37-b234-2216849ba263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0b4d19-0a0c-444b-a162-357834dc5b26', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12773437-7923-4267-9b77-e9909d2fb180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Volume volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 (5d0b4d19-0a0c-444b-a162-357834dc5b26): created successfully
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12773437-7923-4267-9b77-e9909d2fb180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Flow 'volume_create_manager' (ad84c0f9-8124-4bc8-8aca-9eb94e44aa31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b3c4a354-1412-4ea1-b8ba-0f3d5a72ee9f tempest-VolumesTestJSON-47893528 None] Created volume successfully.
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Flow 'volume_create_manager' (6dc491bd-8342-433e-986f-55c88247158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11012d66-a472-42aa-acaa-1024bb33293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11012d66-a472-42aa-acaa-1024bb33293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-148615925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53442e96-4328-4755-bc83-512ba58f4fe4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed67bbb7e874466b056d08e1f221b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:59Z,use_quota=True,user_id='8282571beaac40ceae09cb4138eca00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc8cb17-8675-4805-9158-349a21961f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc8cb17-8675-4805-9158-349a21961f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847f49fd-b088-4ed2-ab24-15bd763aa397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847f49fd-b088-4ed2-ab24-15bd763aa397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53442e96-4328-4755-bc83-512ba58f4fe4', 'volume_name': 'volume-53442e96-4328-4755-bc83-512ba58f4fe4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b426fe-f819-4317-9b40-09236ceb037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b426fe-f819-4317-9b40-09236ceb037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93081427-d250-4f1a-ae3b-fa3f1592c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:35:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Volume 53442e96-4328-4755-bc83-512ba58f4fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53442e96-4328-4755-bc83-512ba58f4fe4', 'volume_size': 1}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-148615925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53442e96-4328-4755-bc83-512ba58f4fe4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ed67bbb7e874466b056d08e1f221b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:35:59Z,use_quota=True,user_id='8282571beaac40ceae09cb4138eca00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Creating volume 53442e96-4328-4755-bc83-512ba58f4fe4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:35:59 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:35:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:35:59 devstack sudo[84946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4 1073741824
Apr 20 23:35:59 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:00 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4 1073741824" returned: 0 in 0.917s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:00 devstack sudo[84979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4
Apr 20 23:36:00 devstack sudo[84979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:01 devstack sudo[84979]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4" returned: 0 in 1.212s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93081427-d250-4f1a-ae3b-fa3f1592c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53442e96-4328-4755-bc83-512ba58f4fe4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb41ac5d-b774-44f6-a198-665a4b257470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=34,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=3 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:36:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Volume volume-53442e96-4328-4755-bc83-512ba58f4fe4 (53442e96-4328-4755-bc83-512ba58f4fe4): created successfully
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb41ac5d-b774-44f6-a198-665a4b257470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Flow 'volume_create_manager' (6dc491bd-8342-433e-986f-55c88247158a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5058501a-0ef5-48ca-bb6e-23387dca1b11 tempest-VolumesTestJSON-47893528 None] Created volume successfully.
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Flow 'volume_create_manager' (ba020958-4bf2-4926-91bf-ec35797531b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567272d1-f11c-4dee-b0b0-74d8a059919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567272d1-f11c-4dee-b0b0-74d8a059919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-949190146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43945d38-c04f-4fde-b18a-e3493276109d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f9b25fd38e4070ac7c0a8f06a0f84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:03Z,use_quota=True,user_id='d821138d3e644b2891d1fb1b0451bcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ad89b4-1b55-4e30-94f6-a8e4b3548279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ad89b4-1b55-4e30-94f6-a8e4b3548279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ea5138-b278-4cb7-be9b-7a5289336456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ea5138-b278-4cb7-be9b-7a5289336456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43945d38-c04f-4fde-b18a-e3493276109d', 'volume_name': 'volume-43945d38-c04f-4fde-b18a-e3493276109d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6484c05f-4ebd-4e43-b084-c4e83cff6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6484c05f-4ebd-4e43-b084-c4e83cff6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e4dd88-e279-43d5-84ae-129162d18d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Volume 43945d38-c04f-4fde-b18a-e3493276109d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43945d38-c04f-4fde-b18a-e3493276109d', 'volume_size': 1}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-949190146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43945d38-c04f-4fde-b18a-e3493276109d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f9b25fd38e4070ac7c0a8f06a0f84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:03Z,use_quota=True,user_id='d821138d3e644b2891d1fb1b0451bcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Creating volume 43945d38-c04f-4fde-b18a-e3493276109d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:03 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:36:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:03 devstack sudo[84986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d 1073741824
Apr 20 23:36:03 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:04 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d 1073741824" returned: 0 in 1.083s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:04 devstack sudo[85003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d
Apr 20 23:36:04 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Acquiring lock "cinder-53442e96-4328-4755-bc83-512ba58f4fe4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Lock "cinder-53442e96-4328-4755-bc83-512ba58f4fe4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Acquiring lock "cinder-quobyte-53442e96-4328-4755-bc83-512ba58f4fe4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Lock "cinder-quobyte-53442e96-4328-4755-bc83-512ba58f4fe4" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b26a3e-a4a8-4af1-9f5b-3541ffb5536f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:05 devstack sudo[85005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4
Apr 20 23:36:05 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:05 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d" returned: 0 in 0.634s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e4dd88-e279-43d5-84ae-129162d18d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43945d38-c04f-4fde-b18a-e3493276109d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0339276-488a-4958-b75b-99b5a7230a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:05 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Volume volume-43945d38-c04f-4fde-b18a-e3493276109d (43945d38-c04f-4fde-b18a-e3493276109d): created successfully
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0339276-488a-4958-b75b-99b5a7230a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Flow 'volume_create_manager' (ba020958-4bf2-4926-91bf-ec35797531b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-90773326-3d4a-429a-bf65-173461fc4dbc tempest-ServerRescueNegativeTestJSON-813856580 None] Created volume successfully.
Apr 20 23:36:05 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4" returned: 0 in 0.664s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:05 devstack sudo[85013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4
Apr 20 23:36:05 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:06 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-53442e96-4328-4755-bc83-512ba58f4fe4" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Lock "cinder-quobyte-53442e96-4328-4755-bc83-512ba58f4fe4" released by "delete_volume" :: held 1.169s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Created reservations ['770da185-544f-4782-88e0-fcccac942dbb', '8f79244c-3a17-4091-9d30-86eaf95cee5a', 'e7515e0f-36c1-451e-9e2d-29ce2064bfb5', '0b4a730e-06a1-449e-b8c5-4ef24a461250'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:06 devstack sudo[85016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:36:06 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:06 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:36:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Deleted volume successfully.
Apr 20 23:36:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8dba8e8b-5084-4149-bb9c-ad5fc4abd417 tempest-VolumesTestJSON-47893528 None] Lock "cinder-53442e96-4328-4755-bc83-512ba58f4fe4-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Acquiring lock "cinder-5d0b4d19-0a0c-444b-a162-357834dc5b26-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Lock "cinder-5d0b4d19-0a0c-444b-a162-357834dc5b26-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Acquiring lock "cinder-quobyte-5d0b4d19-0a0c-444b-a162-357834dc5b26" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Lock "cinder-quobyte-5d0b4d19-0a0c-444b-a162-357834dc5b26" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ce85e-7e7a-4945-b169-77c1982aeb19]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:07 devstack sudo[85021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26
Apr 20 23:36:07 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:07 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26" returned: 0 in 0.587s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:07 devstack sudo[85033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26
Apr 20 23:36:07 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:08 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5d0b4d19-0a0c-444b-a162-357834dc5b26" returned: 0 in 0.567s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Lock "cinder-quobyte-5d0b4d19-0a0c-444b-a162-357834dc5b26" released by "delete_volume" :: held 1.188s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Created reservations ['b2ee5e53-c9b0-4776-a957-6ec44a1d82b3', 'fe5e3efb-3faa-4025-9e0f-25a12dc300ec', '0d681275-e870-4afe-a352-fb36b53dd58d', '21131d50-2d81-4a2f-a119-540849353ea8'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:08 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:36:08 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:09 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.679s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:36:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Deleted volume successfully.
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd4942a-77ab-4964-a79e-da04463b3819 tempest-VolumesTestJSON-47893528 None] Lock "cinder-5d0b4d19-0a0c-444b-a162-357834dc5b26-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Acquiring lock "cinder-699cb503-a589-4105-ad44-d12127bb868b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Lock "cinder-699cb503-a589-4105-ad44-d12127bb868b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Acquiring lock "cinder-quobyte-699cb503-a589-4105-ad44-d12127bb868b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Lock "cinder-quobyte-699cb503-a589-4105-ad44-d12127bb868b" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe9a08-7157-4741-be9f-b52915033c76]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:09 devstack sudo[85095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b
Apr 20 23:36:09 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b" returned: 0 in 0.761s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:10 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:10 devstack sudo[85100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b
Apr 20 23:36:10 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:11 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-699cb503-a589-4105-ad44-d12127bb868b" returned: 0 in 0.921s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Lock "cinder-quobyte-699cb503-a589-4105-ad44-d12127bb868b" released by "delete_volume" :: held 1.720s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Created reservations ['ce76724d-e533-4082-a086-870d0338183c', 'cab48862-a647-43dc-9839-7e9849f3374c', 'e68f7d7e-8279-4a0c-8805-db3866062e7b', '8b6d3d8f-076a-4af1-be4f-9cad736e85bd'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:11 devstack sudo[85146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:36:11 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:11 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.703s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:36:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Deleted volume successfully.
Apr 20 23:36:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-129b0632-77e3-4a29-9ee8-4bf2385dffcc tempest-VolumesTestJSON-47893528 None] Lock "cinder-699cb503-a589-4105-ad44-d12127bb868b-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0de07463-8135-420a-afdf-4328b648e379 tempest-BackendsCapabilitiesAdminTestsJSON-1050232861 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4dc0afce-34c6-4c5c-b6d1-39a87e0745c6 tempest-BackendsCapabilitiesAdminTestsJSON-1050232861 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:15 devstack sudo[85287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:36:15 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:17 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 1.291s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:36:21 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=24,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:36:21 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=3 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:36:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-64ac4f11-59af-495c-91fd-01ce65515354 tempest-GroupSnapshotsTest-571251773 None] Group tempest-GroupSnapshotsTest-Group-73128658: creating
Apr 20 23:36:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-64ac4f11-59af-495c-91fd-01ce65515354 tempest-GroupSnapshotsTest-571251773 None] Group tempest-GroupSnapshotsTest-Group-73128658: created successfully
Apr 20 23:36:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-64ac4f11-59af-495c-91fd-01ce65515354 tempest-GroupSnapshotsTest-571251773 None] Create group completed successfully.
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Acquiring lock "cinder-43945d38-c04f-4fde-b18a-e3493276109d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "cinder-43945d38-c04f-4fde-b18a-e3493276109d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Acquiring lock "cinder-quobyte-43945d38-c04f-4fde-b18a-e3493276109d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "cinder-quobyte-43945d38-c04f-4fde-b18a-e3493276109d" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae520f71-0bcd-4cfb-9482-1cdbee74eb5e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:26 devstack sudo[85453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d
Apr 20 23:36:26 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (9f0517ae-9618-473d-a0db-b59dd72da33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1176e0-cc40-48fc-a5c1-063223e1458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1176e0-cc40-48fc-a5c1-063223e1458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1230783222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=617b55b8-57d8-48d0-a300-257d490c6a3f,host='devstack@QuobyteHD#QuobyteHD',id=1d4965cb-b08c-4e80-b74d-5813ac11332e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:27Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df8d42d1-6e38-4ae9-b10a-7ab069f49b70),volume_type_id=df8d42d1-6e38-4ae9-b10a-7ab069f49b70)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30bbaee-ba79-4667-84a2-a2add390e6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30bbaee-ba79-4667-84a2-a2add390e6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302ccc56-6a73-4acf-b62b-9ad8e1ffb18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302ccc56-6a73-4acf-b62b-9ad8e1ffb18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4965cb-b08c-4e80-b74d-5813ac11332e', 'volume_name': 'volume-1d4965cb-b08c-4e80-b74d-5813ac11332e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e608c1f6-3362-4e5b-add6-c0e03354f466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e608c1f6-3362-4e5b-add6-c0e03354f466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e93db38-ff39-4e54-a12e-095752a7fd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Volume 1d4965cb-b08c-4e80-b74d-5813ac11332e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4965cb-b08c-4e80-b74d-5813ac11332e', 'volume_size': 1}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=617b55b8-57d8-48d0-a300-257d490c6a3f,created_at=2026-04-20T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1230783222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=617b55b8-57d8-48d0-a300-257d490c6a3f,host='devstack@QuobyteHD#QuobyteHD',id=1d4965cb-b08c-4e80-b74d-5813ac11332e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:27Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df8d42d1-6e38-4ae9-b10a-7ab069f49b70),volume_type_id=df8d42d1-6e38-4ae9-b10a-7ab069f49b70)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Creating volume 1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:26 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:36:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:26 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e 1073741824
Apr 20 23:36:26 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:27 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e 1073741824" returned: 0 in 0.860s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:27 devstack sudo[85465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:27 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:27 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d" returned: 0 in 1.206s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:27 devstack sudo[85466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d
Apr 20 23:36:27 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:28 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43945d38-c04f-4fde-b18a-e3493276109d" returned: 0 in 1.031s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "cinder-quobyte-43945d38-c04f-4fde-b18a-e3493276109d" released by "delete_volume" :: held 2.330s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:28 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 1.160s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e93db38-ff39-4e54-a12e-095752a7fd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4965cb-b08c-4e80-b74d-5813ac11332e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83da4ccc-0ac1-4d59-9bcb-ba2ed1806672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Volume volume-1d4965cb-b08c-4e80-b74d-5813ac11332e (1d4965cb-b08c-4e80-b74d-5813ac11332e): created successfully
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83da4ccc-0ac1-4d59-9bcb-ba2ed1806672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (9f0517ae-9618-473d-a0db-b59dd72da33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3f4fa3e7-e0e1-4c16-9ba1-2336d765d70e tempest-GroupSnapshotsTest-571251773 None] Created volume successfully.
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Created reservations ['20691ead-e5f5-4201-b01d-5ae38aa09a4b', '1015fda6-4e4b-4f4e-950b-950f1277390d', '5ef0636c-232f-4256-8694-3824e40dbd4c', '747a0aaa-b80c-4083-be75-1bd4275c3a5e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:29 devstack sudo[85472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:36:29 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:30 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 1.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:36:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Deleted volume successfully.
Apr 20 23:36:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6345dada-d4ef-4554-ad4d-43aa7793699b tempest-ServerRescueNegativeTestJSON-813856580 None] Lock "cinder-43945d38-c04f-4fde-b18a-e3493276109d-delete_volume" released by "delete_volume" :: held 4.321s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] GroupSnapshot 1eef2b54-9b0a-482c-b959-90d87089c7b3: creating.
Apr 20 23:36:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Group snapshot 1eef2b54-9b0a-482c-b959-90d87089c7b3: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 23:36:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Creating offline snapshot cb6d7f98-91d2-48f5-a357-43ba55bdcc50 of volume 1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:36:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bcdbfb-c04d-4eb4-a9ff-54e4edbecc99]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:31 devstack sudo[85512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:31 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:33 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 2.072s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:33 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 1G
Apr 20 23:36:33 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:34 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 1G" returned: 0 in 1.077s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4965cb-b08c-4e80-b74d-5813ac11332e -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:34 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4965cb-b08c-4e80-b74d-5813ac11332e -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50
Apr 20 23:36:34 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:35 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4965cb-b08c-4e80-b74d-5813ac11332e -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50" returned: 0 in 0.661s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:35 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:36:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:35 devstack sudo[85562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50
Apr 20 23:36:35 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:35 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50" returned: 0 in 0.673s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:36 devstack sudo[85565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info
Apr 20 23:36:36 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:36 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info" returned: 0 in 0.751s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:36 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:36:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:36 devstack sudo[85571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info
Apr 20 23:36:36 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:37 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.info" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.858s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9283c097-8bc4-4079-8d92-d7e4056c6376 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 1eef2b54-9b0a-482c-b959-90d87089c7b3: created successfully
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-cb6d7f98-91d2-48f5-a357-43ba55bdcc50-0799503b-96a4-412e-a7cc-c7cee1765d2f" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-cb6d7f98-91d2-48f5-a357-43ba55bdcc50-0799503b-96a4-412e-a7cc-c7cee1765d2f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Creating volume 0799503b-96a4-412e-a7cc-c7cee1765d2f from snapshot cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-0799503b-96a4-412e-a7cc-c7cee1765d2f" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-0799503b-96a4-412e-a7cc-c7cee1765d2f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] snapshot: cb6d7f98-91d2-48f5-a357-43ba55bdcc50, volume: 0799503b-96a4-412e-a7cc-c7cee1765d2f,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[63be5cd8-0177-43fb-9083-70d1e0a17fb4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:40 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50
Apr 20 23:36:40 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:41 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50" returned: 0 in 1.152s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4965cb-b08c-4e80-b74d-5813ac11332e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:36:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:36:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:36:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43604f7f-9d2e-4ab5-aadc-3923fc74dbb8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:41 devstack sudo[85638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:41 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:42 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 1.295s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:42 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:36:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:42 devstack sudo[85646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f
Apr 20 23:36:42 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Flow 'volume_create_manager' (5a8acecc-3eaf-4b96-86f0-d22f183ea10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23a6a0b-02d1-4d28-8d37-4465d5b90cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23a6a0b-02d1-4d28-8d37-4465d5b90cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:42Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e520fc1-be4b-4238-98b5-ca4183ffea41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae28dd4284f3477299eacace86483065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:43Z,use_quota=True,user_id='1baf5117c7304087afa6f7cd9358af3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995eb967-713b-49f6-8e66-d81cdfa2f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995eb967-713b-49f6-8e66-d81cdfa2f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a485914a-cf94-4358-9ca7-0c1ede00c929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.image.glance [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a485914a-cf94-4358-9ca7-0c1ede00c929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e520fc1-be4b-4238-98b5-ca4183ffea41', 'volume_name': 'volume-5e520fc1-be4b-4238-98b5-ca4183ffea41', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f934fc43fd0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c997c4-22b3-48bf-88d9-1b3e34efe885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c997c4-22b3-48bf-88d9-1b3e34efe885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a328d0f-bf74-4085-a8e6-1c74e8e86416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Volume 5e520fc1-be4b-4238-98b5-ca4183ffea41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e520fc1-be4b-4238-98b5-ca4183ffea41', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f934fc43fd0>}
Apr 20 23:36:43 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Trying to clone 5e520fc1-be4b-4238-98b5-ca4183ffea41 from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 23:36:44 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 23:36:44 devstack cinder-volume[82641]: INFO cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 23:36:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2911baa1-de56-4942-89ca-d4ece17da5bc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:45 devstack sudo[85713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD
Apr 20 23:36:45 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:46 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD" returned: 0 in 2.357s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:46 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 is fetched for user 1baf5117c7304087afa6f7cd9358af3c. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 23:36:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a1327-c859-4003-81ea-c416b4e88860]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:47 devstack sudo[85732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD
Apr 20 23:36:47 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:47 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f" returned: 0 in 5.127s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[896655a5-23e4-4863-9a75-9b3a6eae3e88]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:48 devstack sudo[85735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:48 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:48 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD" returned: 0 in 1.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:48 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 0.999s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:48 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:36:48 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Converted 1024.00 MB image at 199.65 MB/s
Apr 20 23:36:48 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:36:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:49 devstack sudo[85746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f
Apr 20 23:36:49 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:49 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f" returned: 0 in 0.681s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-0799503b-96a4-412e-a7cc-c7cee1765d2f" released by "_copy_volume_from_snapshot" :: held 9.428s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-cb6d7f98-91d2-48f5-a357-43ba55bdcc50-0799503b-96a4-412e-a7cc-c7cee1765d2f" released by "_create_volume_from_snapshot" :: held 9.458s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.474s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:42Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e520fc1-be4b-4238-98b5-ca4183ffea41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae28dd4284f3477299eacace86483065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:43Z,use_quota=True,user_id='1baf5117c7304087afa6f7cd9358af3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Creating volume 5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:49 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:36:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:49 devstack sudo[85751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 1073741824
Apr 20 23:36:49 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7050d8a8-a93e-4db4-9cc7-f7a1d9744e0a tempest-GroupSnapshotsTest-571251773 None] Create group from source-snapshot-1eef2b54-9b0a-482c-b959-90d87089c7b3 completed successfully.
Apr 20 23:36:50 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 1073741824" returned: 0 in 0.972s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-0799503b-96a4-412e-a7cc-c7cee1765d2f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-0799503b-96a4-412e-a7cc-c7cee1765d2f" acquired by "delete_volume" :: waited 0.034s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[577e43ff-3e69-4f09-b3ff-3737e707b404]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:50 devstack sudo[85783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:36:50 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:51 devstack sudo[85785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f
Apr 20 23:36:51 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Flow 'volume_create_manager' (74661776-2958-440e-83d3-38d633ad8dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d608d9bc-99ba-4a4f-8f81-fed0437f8e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:51 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d608d9bc-99ba-4a4f-8f81-fed0437f8e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1989366589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407fe815-61e8-4c6d-8ea9-ffe810a2eb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46d48943b9343f39b6dd925c82832b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:51Z,use_quota=True,user_id='146afacb52f94fbcae32abaf3b8bf265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4275b593-f058-4fd8-9c8e-b06e4e125bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4275b593-f058-4fd8-9c8e-b06e4e125bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada43d38-ca95-4dad-b25c-cf2adc9303c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada43d38-ca95-4dad-b25c-cf2adc9303c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407fe815-61e8-4c6d-8ea9-ffe810a2eb80', 'volume_name': 'volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9618cec4-3ac0-468f-abb0-6883f0026cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9618cec4-3ac0-468f-abb0-6883f0026cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9eb3b6c-6bbf-465f-b07d-86bd757c2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Volume 407fe815-61e8-4c6d-8ea9-ffe810a2eb80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80', 'volume_size': 1}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f" returned: 0 in 0.872s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:51 devstack sudo[85793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f
Apr 20 23:36:51 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:51 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 0 in 1.043s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1989366589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407fe815-61e8-4c6d-8ea9-ffe810a2eb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46d48943b9343f39b6dd925c82832b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:51Z,use_quota=True,user_id='146afacb52f94fbcae32abaf3b8bf265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Creating volume 407fe815-61e8-4c6d-8ea9-ffe810a2eb80 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:51 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Attempting download of 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume 5e520fc1-be4b-4238-98b5-ca4183ffea41. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 23:36:51 devstack sudo[85796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 1073741824
Apr 20 23:36:51 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f6a35-f039-455b-b196-92f2b80c07d1]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_ {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:52 devstack sudo[85798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_
Apr 20 23:36:52 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:52 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0799503b-96a4-412e-a7cc-c7cee1765d2f" returned: 0 in 1.125s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-0799503b-96a4-412e-a7cc-c7cee1765d2f" released by "delete_volume" :: held 2.040s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:52 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['6ff38065-0a35-4ca3-bffe-81e7974e2b6b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:52 devstack cinder-volume[82641]: WARNING cinder.quota [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1764915731 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1764915731, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:36:52 devstack cinder-volume[82641]: WARNING cinder.quota [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1764915731 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1764915731, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:36:52 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['a6aa5ee7-534d-473c-b377-3ff1addcdd24', '72b9bc68-a6b0-4055-a8dd-5e53a0c2d3da', '50946aa4-0e9b-4202-92dd-830d27d8e8f4', 'deeabb23-6de9-40d8-b1d9-3225d55318e8'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:53 devstack sudo[85806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:36:53 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:53 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 1073741824" returned: 0 in 1.384s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:53 devstack sudo[85808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80
Apr 20 23:36:53 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:53 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_" returned: 0 in 1.372s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_ {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:53 devstack sudo[85810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_
Apr 20 23:36:53 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:53 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80" returned: 0 in 0.650s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9eb3b6c-6bbf-465f-b07d-86bd757c2dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bd64d8-e2fa-4b0c-bfe9-1f17930fd4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Volume volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 (407fe815-61e8-4c6d-8ea9-ffe810a2eb80): created successfully
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bd64d8-e2fa-4b0c-bfe9-1f17930fd4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Flow 'volume_create_manager' (74661776-2958-440e-83d3-38d633ad8dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-895bdaed-c713-46c7-856e-5d4489867a86 tempest-ServersNegativeTestJSON-482549414 None] Created volume successfully.
Apr 20 23:36:54 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.914s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:36:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c3b4b32d-8012-433e-897d-b5273e796148 tempest-GroupSnapshotsTest-571251773 None] Delete group completed successfully.
Apr 20 23:36:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 1eef2b54-9b0a-482c-b959-90d87089c7b3: deleting
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 1eef2b54-9b0a-482c-b959-90d87089c7b3: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 23:36:54 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-1d4965cb-b08c-4e80-b74d-5813ac11332e" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_" returned: 1 in 1.036s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_w6st_8g_' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1d4965cb-b08c-4e80-b74d-5813ac11332e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-cb6d7f98-91d2-48f5-a357-43ba55bdcc50" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde0a3d9-5ffe-4b12-ba3a-31e00257a1d1]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-cb6d7f98-91d2-48f5-a357-43ba55bdcc50" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Deleting offline snapshot cb6d7f98-91d2-48f5-a357-43ba55bdcc50 of volume 1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] snapshot_file for this snap is: volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3053fa2c-6b83-414d-a2f6-d86a00cd0a1b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:54 devstack sudo[85817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50
Apr 20 23:36:54 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:54 devstack sudo[85816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD
Apr 20 23:36:54 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:36:55 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Flow 'volume_create_manager' (53edaa18-78d8-421d-bd8f-65004d7ab757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030f6410-a314-42b7-977a-660b3a0a962d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030f6410-a314-42b7-977a-660b3a0a962d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1277554031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b49ff6d-0d75-4d6a-8024-49050e4b8d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46207f591bd14e93ad2a296f7c9d2006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:55Z,use_quota=True,user_id='117e83ee7fa1456398512852a290e106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:55 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0eb2ab-92c5-49e7-9866-ece0a8fbaa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:55 devstack sudo[85826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:36:55 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0eb2ab-92c5-49e7-9866-ece0a8fbaa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1f844f-9080-48dd-bb81-9e028b3b9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1f844f-9080-48dd-bb81-9e028b3b9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b49ff6d-0d75-4d6a-8024-49050e4b8d66', 'volume_name': 'volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7f7d5f-0abc-4040-8a72-3f05eecf3609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7f7d5f-0abc-4040-8a72-3f05eecf3609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5713defd-2734-4af8-a7d7-cb642d9134ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Volume 3b49ff6d-0d75-4d6a-8024-49050e4b8d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66', 'volume_size': 1}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1277554031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b49ff6d-0d75-4d6a-8024-49050e4b8d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46207f591bd14e93ad2a296f7c9d2006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:55Z,use_quota=True,user_id='117e83ee7fa1456398512852a290e106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Creating volume 3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:55 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50" returned: 0 in 0.906s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4965cb-b08c-4e80-b74d-5813ac11332e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:36:55 devstack sudo[85828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 1073741824
Apr 20 23:36:55 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1067454e-c608-421f-94b4-b79c651f025a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:55 devstack sudo[85830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:55 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:56 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 1073741824" returned: 0 in 0.874s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:56 devstack sudo[85845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66
Apr 20 23:36:56 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:56 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 1.043s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:56 devstack sudo[85847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50
Apr 20 23:36:56 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Flow 'volume_create_manager' (08da10ac-677d-4233-a9fa-1f6be9879932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c063f4-d9a6-456d-ac96-6af515b45d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c063f4-d9a6-456d-ac96-6af515b45d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-252478103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f05e683-5361-4581-86ab-74700f46e138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46d48943b9343f39b6dd925c82832b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:57Z,use_quota=True,user_id='146afacb52f94fbcae32abaf3b8bf265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52424f9-04ef-4f71-9129-72ea9b7ede5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52424f9-04ef-4f71-9129-72ea9b7ede5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a27bd98-8365-462f-9d56-1512a927bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a27bd98-8365-462f-9d56-1512a927bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f05e683-5361-4581-86ab-74700f46e138', 'volume_name': 'volume-1f05e683-5361-4581-86ab-74700f46e138', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6166e27e-adc9-43bb-91b4-1768dfb3c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6166e27e-adc9-43bb-91b4-1768dfb3c34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4a9657-4343-4449-beb8-a182ffb742bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Volume 1f05e683-5361-4581-86ab-74700f46e138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f05e683-5361-4581-86ab-74700f46e138', 'volume_size': 1}
Apr 20 23:36:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:57 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 0 in 1.893s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_p_l0cnn2devstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:36:57 devstack cinder-volume[82641]: INFO cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Converted 112.00 MB image at 59.15 MB/s
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:57 devstack sudo[85851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 1G
Apr 20 23:36:57 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:57 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" returned: 0 in 0.916s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-252478103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f05e683-5361-4581-86ab-74700f46e138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46d48943b9343f39b6dd925c82832b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:36:57Z,use_quota=True,user_id='146afacb52f94fbcae32abaf3b8bf265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Creating volume 1f05e683-5361-4581-86ab-74700f46e138 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:36:57 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5713defd-2734-4af8-a7d7-cb642d9134ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa88ea-f446-4048-aa7d-e47fad9d8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:57 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Volume volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 (3b49ff6d-0d75-4d6a-8024-49050e4b8d66): created successfully
Apr 20 23:36:57 devstack sudo[85855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138 1073741824
Apr 20 23:36:57 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa88ea-f446-4048-aa7d-e47fad9d8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Flow 'volume_create_manager' (53edaa18-78d8-421d-bd8f-65004d7ab757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-68697d5f-07a2-40fc-8868-7f466a1f53e8 req-c72be09a-a59c-4fc5-a739-654baaaf4c7f tempest-VolumesSnapshotsTestJSON-1990700812 None] Created volume successfully.
Apr 20 23:36:57 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50" returned: 0 in 1.008s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:57 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50
Apr 20 23:36:57 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:36:57 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 1G" returned: 0 in 0.797s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec839043-55e7-4973-ad27-6c2ca98ad0f6]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:57 devstack sudo[85866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:36:57 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:58 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e.cb6d7f98-91d2-48f5-a357-43ba55bdcc50" returned: 0 in 0.654s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-cb6d7f98-91d2-48f5-a357-43ba55bdcc50" released by "_delete_snapshot" :: held 3.709s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1d4965cb-b08c-4e80-b74d-5813ac11332e" released by "delete_snapshot" :: held 3.768s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:36:58 devstack cinder-volume[82641]: WARNING cinder.quota [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1764915731 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1764915731, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['d15f00d8-db71-47e3-ae26-fd856b028c58', 'e1672aa1-a77a-48f7-acb7-37f94186c6d0', '71fdfee9-1569-4597-96b0-8251b3dea93e', 'd48c7648-09ab-4e69-92fd-19f10bd66fa3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:36:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-313f8c0a-deec-4c10-9e88-f2277cc91b37 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 1eef2b54-9b0a-482c-b959-90d87089c7b3: deleted successfully
Apr 20 23:36:58 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138 1073741824" returned: 0 in 1.116s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:58 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138
Apr 20 23:36:58 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:58 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 0 in 0.620s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:58 devstack sudo[85873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:36:58 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-1d4965cb-b08c-4e80-b74d-5813ac11332e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1d4965cb-b08c-4e80-b74d-5813ac11332e" acquired by "delete_volume" :: waited 0.022s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:36:58 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138" returned: 0 in 0.597s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.230s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45ba9f-8de6-4f1f-b5af-e52c0e8d05cc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Creating offline snapshot ba121792-e6f9-4b9f-909f-3d05ff0e3a19 of volume 3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4a9657-4343-4449-beb8-a182ffb742bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f05e683-5361-4581-86ab-74700f46e138', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4c899f-969b-4f96-9b64-12b779ba6432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d522d60-07f4-4522-ba7b-36e5f572318a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Volume volume-1f05e683-5361-4581-86ab-74700f46e138 (1f05e683-5361-4581-86ab-74700f46e138): created successfully
Apr 20 23:36:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4c899f-969b-4f96-9b64-12b779ba6432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Flow 'volume_create_manager' (08da10ac-677d-4233-a9fa-1f6be9879932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8a24f60a-52c7-48fe-b3eb-c20e7afa70b0 tempest-ServersNegativeTestJSON-482549414 None] Created volume successfully.
Apr 20 23:36:59 devstack sudo[85877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66
Apr 20 23:36:59 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:59 devstack sudo[85876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:59 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:59 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 1 in 0.818s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Downloaded image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume 5e520fc1-be4b-4238-98b5-ca4183ffea41 successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 for user 1baf5117c7304087afa6f7cd9358af3c is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Marking volume 5e520fc1-be4b-4238-98b5-ca4183ffea41 as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Copying metadata from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 to 5e520fc1-be4b-4238-98b5-ca4183ffea41. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Creating volume glance metadata for volume 5e520fc1-be4b-4238-98b5-ca4183ffea41 backed by image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a328d0f-bf74-4085-a8e6-1c74e8e86416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e520fc1-be4b-4238-98b5-ca4183ffea41', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f934fc43fd0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eaa66f-57d0-42e1-93d0-1a041901b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:36:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Volume volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 (5e520fc1-be4b-4238-98b5-ca4183ffea41): created successfully
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eaa66f-57d0-42e1-93d0-1a041901b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Flow 'volume_create_manager' (5a8acecc-3eaf-4b96-86f0-d22f183ea10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:36:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-45fd2750-da78-49e4-82ec-8d6832b2e785 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Created volume successfully.
Apr 20 23:36:59 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" returned: 0 in 0.700s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:59 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 0.745s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:36:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:36:59 devstack sudo[85889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 1G
Apr 20 23:36:59 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:36:59 devstack sudo[85890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e
Apr 20 23:36:59 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:00 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 1G" returned: 0 in 0.639s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:00 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1d4965cb-b08c-4e80-b74d-5813ac11332e" returned: 0 in 0.635s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:00 devstack sudo[85897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19
Apr 20 23:37:00 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1d4965cb-b08c-4e80-b74d-5813ac11332e" released by "delete_volume" :: held 1.497s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "cinder-1f05e683-5361-4581-86ab-74700f46e138-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-1f05e683-5361-4581-86ab-74700f46e138-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "cinder-quobyte-1f05e683-5361-4581-86ab-74700f46e138" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-quobyte-1f05e683-5361-4581-86ab-74700f46e138" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Created reservations ['dfb3d834-397d-4ca9-bba9-79e56b8a19e7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b889d18-dd62-463f-a53b-a0168f531322]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:00 devstack cinder-volume[82641]: WARNING cinder.db.sqlalchemy.api [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1764915731']
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Created reservations ['ccf849a1-502a-4b96-ae1f-48f6ff347569', '35fd8326-b165-4316-9506-29db208b11b4', '62701995-64eb-49cd-a893-a26a59448e54', 'bb5c8da3-7407-44d4-a268-b6a8215ef48f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:00 devstack sudo[85899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138
Apr 20 23:37:00 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:00 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:00 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:00 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19" returned: 0 in 0.651s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:00 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 is being set with open permissions: ugo+rw
Apr 20 23:37:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:01 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19
Apr 20 23:37:01 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-15ae4b25-c211-4769-9cf8-f0844014208d tempest-GroupSnapshotsTest-571251773 None] Group tempest-GroupSnapshotsTest-Group-2056330570: creating
Apr 20 23:37:01 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138" returned: 0 in 1.177s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:01 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.973s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:01 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-15ae4b25-c211-4769-9cf8-f0844014208d tempest-GroupSnapshotsTest-571251773 None] Group tempest-GroupSnapshotsTest-Group-2056330570: created successfully
Apr 20 23:37:01 devstack sudo[85912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138
Apr 20 23:37:01 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-15ae4b25-c211-4769-9cf8-f0844014208d tempest-GroupSnapshotsTest-571251773 None] Create group completed successfully.
Apr 20 23:37:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6be4d851-e5de-4f46-8367-1f444dec3e8d tempest-GroupSnapshotsTest-571251773 None] Delete group completed successfully.
Apr 20 23:37:01 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19" returned: 0 in 0.821s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:01 devstack sudo[85915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info
Apr 20 23:37:01 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:02 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1f05e683-5361-4581-86ab-74700f46e138" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-quobyte-1f05e683-5361-4581-86ab-74700f46e138" released by "delete_volume" :: held 1.765s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Created reservations ['f4f454fc-9dfa-4ac5-995b-fbfe82b6de66', '282f1cda-9469-4cd7-ac84-86ffc54201fc', '7dfedad6-6e09-4c0b-ae08-2729843b316d', '59b7ea3e-a83f-408c-b38b-04815e154f95'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:02 devstack sudo[85927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:02 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:02 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:02 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info is being set with open permissions: ugo+rw
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:02 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info
Apr 20 23:37:02 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "cinder-407fe815-61e8-4c6d-8ea9-ffe810a2eb80-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-407fe815-61e8-4c6d-8ea9-ffe810a2eb80-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "cinder-quobyte-407fe815-61e8-4c6d-8ea9-ffe810a2eb80" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-quobyte-407fe815-61e8-4c6d-8ea9-ffe810a2eb80" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[20255de3-7d99-4bd3-b4dc-60a43a5f0240]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:02 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.432s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Deleted volume successfully.
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-14af5bdc-fc42-4f6a-bdd1-e5473025792e tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-1f05e683-5361-4581-86ab-74700f46e138-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:02 devstack sudo[85932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80
Apr 20 23:37:02 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:02 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.info" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.948s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.507s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-aea2b111-4930-4ff8-b160-26104a467e41 req-6c2b67b9-e98c-43a7-b99b-9955f59b5a00 tempest-VolumesSnapshotsTestJSON-1990700812 None] Create snapshot completed successfully
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d928b4e7-0a61-468e-9b63-9a3eef6bbea4]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:02 devstack sudo[85935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:37:02 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (a6e6cff1-ab02-4435-87b8-1c8fd3d713e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d05dfd-5317-4d6a-a695-8d76bdf93cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d05dfd-5317-4d6a-a695-8d76bdf93cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799814667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03682c93-10b6-4844-aba9-3b12e10c9c8b,host='devstack@QuobyteHD#QuobyteHD',id=8cf08d44-f2f7-4bab-acab-d3141f7cead6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:03Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(437d2f69-7faf-4b2f-ad67-1f84505e2036),volume_type_id=437d2f69-7faf-4b2f-ad67-1f84505e2036)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b6c1ad-9d18-46e1-8816-7ce382ffb27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b6c1ad-9d18-46e1-8816-7ce382ffb27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6f4abb-b24a-4c2d-91d1-53f72ee9f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6f4abb-b24a-4c2d-91d1-53f72ee9f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf08d44-f2f7-4bab-acab-d3141f7cead6', 'volume_name': 'volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71ffc93-af18-4d92-b68e-7dcc8d8aa15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71ffc93-af18-4d92-b68e-7dcc8d8aa15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2591ddde-d70c-4081-80fe-1a96084aa942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Volume 8cf08d44-f2f7-4bab-acab-d3141f7cead6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6', 'volume_size': 1}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "cinder-ba121792-e6f9-4b9f-909f-3d05ff0e3a19-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-ba121792-e6f9-4b9f-909f-3d05ff0e3a19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "cinder-quobyte-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-quobyte-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "cinder-quobyte-ba121792-e6f9-4b9f-909f-3d05ff0e3a19" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-quobyte-ba121792-e6f9-4b9f-909f-3d05ff0e3a19" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Deleting offline snapshot ba121792-e6f9-4b9f-909f-3d05ff0e3a19 of volume 3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] snapshot_file for this snap is: volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c257de26-f8d5-4d33-ae56-62f5139f20e2]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:03 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:03 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19
Apr 20 23:37:03 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:03 devstack sudo[85941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80
Apr 20 23:37:03 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:03 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 0 in 0.553s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:03 devstack sudo[85946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:37:03 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:03 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19" returned: 0 in 0.490s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[310d8702-d369-4357-9262-de44ec768bf0]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:03 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-407fe815-61e8-4c6d-8ea9-ffe810a2eb80" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-quobyte-407fe815-61e8-4c6d-8ea9-ffe810a2eb80" released by "delete_volume" :: held 1.090s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Created reservations ['1dc462b6-855a-4a98-b68f-771a3a62e147', 'd9577798-3c16-4f85-b11f-43913a80b135', '3edd874b-970a-4ae1-8f79-892409d3d077', '0d3ea929-26e8-49c8-accb-eaadde639a80'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:03 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66
Apr 20 23:37:03 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:03 devstack sudo[85955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:03 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:03 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 1 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.121s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=03682c93-10b6-4844-aba9-3b12e10c9c8b,created_at=2026-04-20T21:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799814667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03682c93-10b6-4844-aba9-3b12e10c9c8b,host='devstack@QuobyteHD#QuobyteHD',id=8cf08d44-f2f7-4bab-acab-d3141f7cead6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:03Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(437d2f69-7faf-4b2f-ad67-1f84505e2036),volume_type_id=437d2f69-7faf-4b2f-ad67-1f84505e2036)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Creating volume 8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:03 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:03 devstack sudo[85959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 1073741824
Apr 20 23:37:03 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b', 'name': 'volume-5e520fc1-be4b-4238-98b5-ca4183ffea41', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '238494fe-cc8c-49b8-949e-375d7072535b', 'enforce_multipath': True} {{(pid=82641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 23:37:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-57c6b651-38e2-49f5-be25-e151073d3648 req-533d9bfc-2bc4-493c-b877-083263661fbd tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] attachment_update completed successfully.
Apr 20 23:37:04 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" returned: 0 in 0.530s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:04 devstack sudo[85965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19
Apr 20 23:37:04 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:04 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Deleted volume successfully.
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c0189af-c0df-48f0-bd16-1fbeb7a06368 tempest-ServersNegativeTestJSON-482549414 None] Lock "cinder-407fe815-61e8-4c6d-8ea9-ffe810a2eb80-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:04 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 1073741824" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:04 devstack sudo[85970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6
Apr 20 23:37:04 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:04 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19" returned: 0 in 0.485s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:04 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19
Apr 20 23:37:04 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:04 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2591ddde-d70c-4081-80fe-1a96084aa942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecc8312-ac11-4d16-9f93-0b5fadd1d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:05 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Volume volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 (8cf08d44-f2f7-4bab-acab-d3141f7cead6): created successfully
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecc8312-ac11-4d16-9f93-0b5fadd1d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (a6e6cff1-ab02-4435-87b8-1c8fd3d713e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-13eebf45-1255-4994-9b3a-475a23dbae49 tempest-GroupSnapshotsTest-571251773 None] Created volume successfully.
Apr 20 23:37:05 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66.ba121792-e6f9-4b9f-909f-3d05ff0e3a19" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-quobyte-ba121792-e6f9-4b9f-909f-3d05ff0e3a19" released by "_delete_snapshot" :: held 2.050s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-quobyte-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" released by "delete_snapshot" :: held 2.060s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:05 devstack cinder-volume[82641]: WARNING cinder.quota [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.quota [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Created reservations ['ea749073-93eb-4c9e-9f3e-b846c0641603', 'a6ffe4d9-83bb-424b-a6be-27e0c87228dc', '3a30d024-4087-4a13-8e14-e97580a29e23', '61421ee8-a52d-476f-8321-63d9073e574c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Delete snapshot completed successfully.
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-85a55ae3-5ad0-46d2-b752-256c0f3d7f4c req-82e4191a-7196-41c3-b6c5-f4862a2ff4d0 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-ba121792-e6f9-4b9f-909f-3d05ff0e3a19-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (860ada14-79e3-4067-a562-e9379d8f2f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b062b9dd-eb83-4505-8fbc-76cde1e99d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b062b9dd-eb83-4505-8fbc-76cde1e99d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789120895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03682c93-10b6-4844-aba9-3b12e10c9c8b,host='devstack@QuobyteHD#QuobyteHD',id=373954aa-594b-4049-b912-8abc4525f712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:05Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(437d2f69-7faf-4b2f-ad67-1f84505e2036),volume_type_id=437d2f69-7faf-4b2f-ad67-1f84505e2036)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0b1a7f-e2fb-4cc5-9c52-77ee75ba2d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0b1a7f-e2fb-4cc5-9c52-77ee75ba2d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8e4fd2-8ee8-4c63-98a1-b0832559b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8e4fd2-8ee8-4c63-98a1-b0832559b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373954aa-594b-4049-b912-8abc4525f712', 'volume_name': 'volume-373954aa-594b-4049-b912-8abc4525f712', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7a0229-21bd-450b-a235-b477d280785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7a0229-21bd-450b-a235-b477d280785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120b7b02-f2c4-417b-b825-1a988088942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:05 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Volume 373954aa-594b-4049-b912-8abc4525f712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373954aa-594b-4049-b912-8abc4525f712', 'volume_size': 1}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=03682c93-10b6-4844-aba9-3b12e10c9c8b,created_at=2026-04-20T21:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789120895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03682c93-10b6-4844-aba9-3b12e10c9c8b,host='devstack@QuobyteHD#QuobyteHD',id=373954aa-594b-4049-b912-8abc4525f712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:05Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(437d2f69-7faf-4b2f-ad67-1f84505e2036),volume_type_id=437d2f69-7faf-4b2f-ad67-1f84505e2036)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Creating volume 373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:05 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:05 devstack sudo[85980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 1073741824
Apr 20 23:37:05 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:06 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 1073741824" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:06 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712
Apr 20 23:37:06 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "cinder-3b49ff6d-0d75-4d6a-8024-49050e4b8d66-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-3b49ff6d-0d75-4d6a-8024-49050e4b8d66-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "cinder-quobyte-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-quobyte-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f01fc-6556-4bc5-8f78-56608ce62021]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:06 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66
Apr 20 23:37:06 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:06 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712" returned: 0 in 0.550s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120b7b02-f2c4-417b-b825-1a988088942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373954aa-594b-4049-b912-8abc4525f712', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ae4851-66ee-4295-8f5e-5790c15a4d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:06 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Volume volume-373954aa-594b-4049-b912-8abc4525f712 (373954aa-594b-4049-b912-8abc4525f712): created successfully
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ae4851-66ee-4295-8f5e-5790c15a4d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (860ada14-79e3-4067-a562-e9379d8f2f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0cf9f302-f518-4703-ae59-b6ca17535a82 tempest-GroupSnapshotsTest-571251773 None] Created volume successfully.
Apr 20 23:37:07 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" returned: 0 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:07 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66
Apr 20 23:37:07 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:07 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-quobyte-3b49ff6d-0d75-4d6a-8024-49050e4b8d66" released by "delete_volume" :: held 1.021s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG cinder.quota [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Created reservations ['4de29baf-e7be-4b60-92c7-c9b7c8da7436', 'a4ad0f5c-a67d-4f8b-b318-9add5071c2c2', '0316bc2c-e438-4548-9228-77c710e37b02', '10417093-8d19-452b-8fc0-b1484e47be16'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:07 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:07 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cb114d73-ac6d-46b6-bf12-0536633ebe7d tempest-GroupSnapshotsTest-571251773 None] Update group completed successfully.
Apr 20 23:37:08 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.594s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:08 devstack cinder-volume[82641]: DEBUG cinder.manager [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Deleted volume successfully.
Apr 20 23:37:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-d8e231f0-11a5-454c-a234-d0cc49c580a2 req-ec396311-95f3-43f8-a4bb-9b8c9fddb2b3 tempest-VolumesSnapshotsTestJSON-1990700812 None] Lock "cinder-3b49ff6d-0d75-4d6a-8024-49050e4b8d66-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-17689443-6b63-4f7f-a1c9-376a8a8338a6 tempest-GroupSnapshotsTest-571251773 None] Update group completed successfully.
Apr 20 23:37:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-001cabf3-fa91-4879-8e14-29cc8a0de8b2 tempest-GroupSnapshotsTest-571251773 None] Update group completed successfully.
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Flow 'volume_create_manager' (07d79cfa-f5f4-4362-8224-7d85774a5fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9244a56-a664-481f-b5f1-b6a73d94f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9244a56-a664-481f-b5f1-b6a73d94f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2010143515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd86c798-c1ff-444c-b2ff-14b7fc0f633d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9ba129af4497390988bf18bc84be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:11Z,use_quota=True,user_id='11226a0afcbf4109a4591018d1e1b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09efbf75-93ab-486f-9a8c-fb14d4f29ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09efbf75-93ab-486f-9a8c-fb14d4f29ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7d4baf-c62e-4dbb-b228-cd1eaef331eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7d4baf-c62e-4dbb-b228-cd1eaef331eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd86c798-c1ff-444c-b2ff-14b7fc0f633d', 'volume_name': 'volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca01ea94-82ff-40f1-80f1-1bc68f9c3f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca01ea94-82ff-40f1-80f1-1bc68f9c3f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9f4edb-17ac-47fc-b68c-7c67699b3bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Volume dd86c798-c1ff-444c-b2ff-14b7fc0f633d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d', 'volume_size': 1}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2010143515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd86c798-c1ff-444c-b2ff-14b7fc0f633d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c9d9ba129af4497390988bf18bc84be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:11Z,use_quota=True,user_id='11226a0afcbf4109a4591018d1e1b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Creating volume dd86c798-c1ff-444c-b2ff-14b7fc0f633d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:10 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:10 devstack sudo[86058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d 1073741824
Apr 20 23:37:10 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:11 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d 1073741824" returned: 0 in 0.657s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:11 devstack sudo[86063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d
Apr 20 23:37:11 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fa0c2973-61d5-4751-be4f-14a79917eefc tempest-GroupSnapshotsTest-571251773 None] Update group completed successfully.
Apr 20 23:37:12 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d" returned: 0 in 0.641s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9f4edb-17ac-47fc-b68c-7c67699b3bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1804e9-75d8-41a0-a04e-422e3931c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Volume volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d (dd86c798-c1ff-444c-b2ff-14b7fc0f633d): created successfully
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1804e9-75d8-41a0-a04e-422e3931c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Flow 'volume_create_manager' (07d79cfa-f5f4-4362-8224-7d85774a5fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-864d0270-ba57-4971-bec8-9c28ec930438 req-befcbc60-dae0-4193-ac6d-58770c6f0bf2 tempest-VolumesGetTestJSON-773605295 None] Created volume successfully.
Apr 20 23:37:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] GroupSnapshot 7aeaded1-bfc4-4c24-a0e2-9c5d7d6f3167: creating.
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Group snapshot 7aeaded1-bfc4-4c24-a0e2-9c5d7d6f3167: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Creating offline snapshot 2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c of volume 8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd896ede-fbd0-4328-bc13-28b2f357c89f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Acquiring lock "cinder-dd86c798-c1ff-444c-b2ff-14b7fc0f633d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Lock "cinder-dd86c798-c1ff-444c-b2ff-14b7fc0f633d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Acquiring lock "cinder-quobyte-dd86c798-c1ff-444c-b2ff-14b7fc0f633d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Lock "cinder-quobyte-dd86c798-c1ff-444c-b2ff-14b7fc0f633d" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e89dc-4f54-4ddb-9666-bef9dceae100]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:13 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6
Apr 20 23:37:13 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:13 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d
Apr 20 23:37:13 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:13 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6" returned: 0 in 0.708s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:13 devstack sudo[86078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c 1G
Apr 20 23:37:13 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:13 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d" returned: 0 in 0.665s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:13 devstack sudo[86080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d
Apr 20 23:37:13 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:14 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd86c798-c1ff-444c-b2ff-14b7fc0f633d" returned: 0 in 0.729s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Lock "cinder-quobyte-dd86c798-c1ff-444c-b2ff-14b7fc0f633d" released by "delete_volume" :: held 1.445s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:14 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c 1G" returned: 0 in 0.860s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:14 devstack sudo[86087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG cinder.quota [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Created reservations ['91dca3df-25c7-4436-b935-d2f0f202414c', 'cd5a9e50-1f45-413b-acc6-0fbc6b69f8e3', '3a1bb793-5a4c-4fcf-86a6-e2997dc019f0', 'f87c200f-d0e8-46e2-9cce-0478bd82cd27'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:14 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:14 devstack sudo[86089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:14 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:15 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" returned: 0 in 0.539s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:15 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:15 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c
Apr 20 23:37:15 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:15 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.569s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG cinder.manager [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Deleted volume successfully.
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-0920feee-9b6a-44b9-bf23-e2617a5f7b1a req-f62985cc-0799-4028-a19b-f6cd24dd16b0 tempest-VolumesGetTestJSON-773605295 None] Lock "cinder-dd86c798-c1ff-444c-b2ff-14b7fc0f633d-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:15 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" returned: 0 in 0.545s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:15 devstack sudo[86098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info
Apr 20 23:37:15 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:15 devstack sudo[86100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:15 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:16 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info" returned: 0 in 0.613s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:16 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:16 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info
Apr 20 23:37:16 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:16 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.855s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:17 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.info" returned: 0 in 0.671s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.051s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Creating offline snapshot f9daf569-752f-44f1-933c-3d2ea618c30d of volume 373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[feedfc95-eb5a-4166-b81d-2aa47a98b11e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:17 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712
Apr 20 23:37:17 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:17 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712" returned: 0 in 0.694s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:17 devstack sudo[86136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d 1G
Apr 20 23:37:17 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:18 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d 1G" returned: 0 in 0.626s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373954aa-594b-4049-b912-8abc4525f712 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:18 devstack sudo[86149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373954aa-594b-4049-b912-8abc4525f712 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d
Apr 20 23:37:18 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:19 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373954aa-594b-4049-b912-8abc4525f712 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d" returned: 0 in 0.702s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:19 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:19 devstack sudo[86172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d
Apr 20 23:37:19 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:19 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:19 devstack sudo[86175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info
Apr 20 23:37:19 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:20 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:20 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:20 devstack sudo[86190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info
Apr 20 23:37:20 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:20 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.info" returned: 0 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-20bef150-f3f2-478b-adab-c8f749190431 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 7aeaded1-bfc4-4c24-a0e2-9c5d7d6f3167: created successfully
Apr 20 23:37:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 7aeaded1-bfc4-4c24-a0e2-9c5d7d6f3167: deleting
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=127,cinder:UPDATE=102,cinder:INSERT=29,cinder:DELETE=5 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 7aeaded1-bfc4-4c24-a0e2-9c5d7d6f3167: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-8cf08d44-f2f7-4bab-acab-d3141f7cead6" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-8cf08d44-f2f7-4bab-acab-d3141f7cead6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Deleting offline snapshot 2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c of volume 8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] snapshot_file for this snap is: volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f29b9-9255-451b-857a-336689dd9d7c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:21 devstack sudo[86196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c
Apr 20 23:37:21 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:22 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" returned: 0 in 0.649s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:37:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb66370-05df-4134-8b48-e849ade7ce27]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:22 devstack sudo[86201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6
Apr 20 23:37:22 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:22 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6" returned: 0 in 0.598s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:22 devstack sudo[86206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c
Apr 20 23:37:22 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:23 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" returned: 0 in 0.852s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:23 devstack sudo[86272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c
Apr 20 23:37:23 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=114,cinder:UPDATE=126,cinder:INSERT=34,cinder:DELETE=9 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:24 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Flow 'volume_create_manager' (0c038bfb-b5bd-4d91-bf63-feebc5079846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e18efdf-a513-4cb4-8aab-070ae8d92f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e18efdf-a513-4cb4-8aab-070ae8d92f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1600273808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2593e949-4cd5-4c1f-bfd6-0d7562aaf81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf039b2e83c49a5ad2129b88870024e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:24Z,use_quota=True,user_id='4da40738eb8e413c920347e642a008b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45216d49-c5e7-496c-a168-851729c8f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45216d49-c5e7-496c-a168-851729c8f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1211640c-8037-465a-aef4-03d15a825334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1211640c-8037-465a-aef4-03d15a825334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2593e949-4cd5-4c1f-bfd6-0d7562aaf81c', 'volume_name': 'volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b247ee8-adbd-4cf5-962d-dd6061c2519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b247ee8-adbd-4cf5-962d-dd6061c2519e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9d47d7-57c7-451e-a1d6-af0da9f04c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Volume 2593e949-4cd5-4c1f-bfd6-0d7562aaf81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c', 'volume_size': 1}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1600273808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2593e949-4cd5-4c1f-bfd6-0d7562aaf81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf039b2e83c49a5ad2129b88870024e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:24Z,use_quota=True,user_id='4da40738eb8e413c920347e642a008b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Creating volume 2593e949-4cd5-4c1f-bfd6-0d7562aaf81c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:24 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6.2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" returned: 0 in 0.810s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:24 devstack sudo[86276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c 1073741824
Apr 20 23:37:24 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-2b450aaf-46f2-4a5e-9001-ed0d1cc85b6c" released by "_delete_snapshot" :: held 3.013s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-8cf08d44-f2f7-4bab-acab-d3141f7cead6" released by "delete_snapshot" :: held 3.064s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-373954aa-594b-4049-b912-8abc4525f712" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-373954aa-594b-4049-b912-8abc4525f712" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-f9daf569-752f-44f1-933c-3d2ea618c30d" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-f9daf569-752f-44f1-933c-3d2ea618c30d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Deleting offline snapshot f9daf569-752f-44f1-933c-3d2ea618c30d of volume 373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] snapshot_file for this snap is: volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cecab5c-508a-4c1f-a83c-0b33dd6820c3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:24 devstack sudo[86278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d
Apr 20 23:37:24 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:25 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c 1073741824" returned: 0 in 0.687s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:25 devstack sudo[86286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c
Apr 20 23:37:25 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:25 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d" returned: 0 in 0.687s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-373954aa-594b-4049-b912-8abc4525f712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:37:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab9fdc-fc10-4674-ab78-fb915d025fdf]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:25 devstack sudo[86288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712
Apr 20 23:37:25 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:26 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712" returned: 0 in 0.628s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:26 devstack sudo[86296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d
Apr 20 23:37:26 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:26 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c" returned: 0 in 0.829s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9d47d7-57c7-451e-a1d6-af0da9f04c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cfca63-b362-4225-a4b6-cba2512823fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Volume volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c (2593e949-4cd5-4c1f-bfd6-0d7562aaf81c): created successfully
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cfca63-b362-4225-a4b6-cba2512823fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Flow 'volume_create_manager' (0c038bfb-b5bd-4d91-bf63-feebc5079846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3918cee1-30fa-432e-a681-794ba9457a08 tempest-VolumeQuotasNegativeTestJSON-17533731 None] Created volume successfully.
Apr 20 23:37:26 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:26 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d
Apr 20 23:37:26 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:27 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712.f9daf569-752f-44f1-933c-3d2ea618c30d" returned: 0 in 0.666s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-f9daf569-752f-44f1-933c-3d2ea618c30d" released by "_delete_snapshot" :: held 2.618s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-373954aa-594b-4049-b912-8abc4525f712" released by "delete_snapshot" :: held 2.629s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:27 devstack cinder-volume[82641]: WARNING cinder.quota [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-561474743 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-561474743, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:27 devstack cinder-volume[82641]: WARNING cinder.quota [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-561474743 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-561474743, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['aed3b797-2bd6-4b34-9085-f43954e907f6', 'e4cac054-bd11-450e-9ea3-118fd5562f5f', '62b1de0d-954b-4a25-bf0e-5e553aed5cab', '96a63b12-c602-4418-8914-8aa40a72dd6c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['73db02cc-82dd-412a-821e-8d8c1a141238', 'cc9ea433-7c48-47cb-a3f5-a094f38b82fc', 'f9099d04-eea0-48a2-bb7c-61bb2f018467', '2763d748-6d88-46c8-90a4-e837f12b8fa8'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-520c5fa8-e9e8-4994-a2fd-c5d06ddce5a1 tempest-GroupSnapshotsTest-571251773 None] group_snapshot 7aeaded1-bfc4-4c24-a0e2-9c5d7d6f3167: deleted successfully
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Acquiring lock "cinder-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "cinder-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Acquiring lock "cinder-quobyte-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "cinder-quobyte-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[36384efd-e4ad-4801-b114-5f99507a1354]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:27 devstack sudo[86305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c
Apr 20 23:37:27 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-373954aa-594b-4049-b912-8abc4525f712" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-373954aa-594b-4049-b912-8abc4525f712" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c205da-d729-4358-bce5-2df80c897c8c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:28 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c" returned: 0 in 0.763s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:28 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712
Apr 20 23:37:28 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:28 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c
Apr 20 23:37:28 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:28 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:28 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712" returned: 0 in 0.661s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "cinder-quobyte-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c" released by "delete_volume" :: held 1.394s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:29 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712
Apr 20 23:37:29 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Created reservations ['dfe65ab8-33f8-4a34-9187-e337c0eb096b', 'cf17a439-5721-47c7-87a7-a8089767c1d5', 'fef0f44f-a9df-4883-8936-cfc52cbe31ab', '678ca115-5dc5-4b1a-ab50-bd15c645718f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:29 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:29 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:29 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-373954aa-594b-4049-b912-8abc4525f712" returned: 0 in 0.612s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-373954aa-594b-4049-b912-8abc4525f712" released by "delete_volume" :: held 1.318s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-8cf08d44-f2f7-4bab-acab-d3141f7cead6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-8cf08d44-f2f7-4bab-acab-d3141f7cead6" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[990f7f59-f22b-4de6-8e4c-d1a661c12baa]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:29 devstack sudo[86369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6
Apr 20 23:37:29 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:29 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.717s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Deleted volume successfully.
Apr 20 23:37:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94b57f35-2880-41c5-b4b1-f873f8be464e tempest-VolumeQuotasNegativeTestJSON-17533731 None] Lock "cinder-2593e949-4cd5-4c1f-bfd6-0d7562aaf81c-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:30 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6" returned: 0 in 0.755s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:30 devstack sudo[86375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6
Apr 20 23:37:30 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:31 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8cf08d44-f2f7-4bab-acab-d3141f7cead6" returned: 0 in 0.665s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-8cf08d44-f2f7-4bab-acab-d3141f7cead6" released by "delete_volume" :: held 1.472s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['d739bcb1-c982-436f-aa91-1aac786dd1e4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:31 devstack cinder-volume[82641]: WARNING cinder.quota [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-561474743 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-561474743, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['bc557fcd-62d8-411c-980d-e07117056396', '9e1763ab-ae7c-4b70-8566-90432b9ff94f', 'd4fec0c6-7344-488c-9245-e9c1421079fe', '082d5eb1-519a-4d4c-b83e-833b712c556c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Created reservations ['cd981cde-4133-4ada-841d-3e05df8c36b6', '160fa276-a7dc-449c-9caa-c6a8e33e1852', '892664ed-1bd2-4a6f-bdfb-68fb7ada891c', '0ac96257-815b-4bad-919f-e927cbad7c30'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:31 devstack sudo[86379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:31 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3eb2ea24-666a-43ad-b5fb-70b0c3150a6c tempest-GroupSnapshotsTest-571251773 None] Group tempest-GroupSnapshotsTest-Group-1282670890: creating
Apr 20 23:37:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3eb2ea24-666a-43ad-b5fb-70b0c3150a6c tempest-GroupSnapshotsTest-571251773 None] Group tempest-GroupSnapshotsTest-Group-1282670890: created successfully
Apr 20 23:37:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3eb2ea24-666a-43ad-b5fb-70b0c3150a6c tempest-GroupSnapshotsTest-571251773 None] Create group completed successfully.
Apr 20 23:37:32 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.965s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:32 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a1b3e32a-7db1-4399-9b03-e58274c86e09 tempest-GroupSnapshotsTest-571251773 None] Delete group completed successfully.
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (75606b34-db7e-4c79-93de-823bc1e2c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84051552-60ff-4b56-9db4-df256fc7e4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84051552-60ff-4b56-9db4-df256fc7e4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212893714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e07d41f-3da7-49fe-9d4a-f9766e0f09c9,host='devstack@QuobyteHD#QuobyteHD',id=1703bdb8-4d83-4395-91a7-863cb92abbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:34Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d18c4ee-eef9-4e8f-b7d3-419659bee568),volume_type_id=2d18c4ee-eef9-4e8f-b7d3-419659bee568)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f9d711-4c09-47d3-a482-767b042758b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f9d711-4c09-47d3-a482-767b042758b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93c006f-c3e0-4fa5-a833-4e5052fb4f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93c006f-c3e0-4fa5-a833-4e5052fb4f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1703bdb8-4d83-4395-91a7-863cb92abbe9', 'volume_name': 'volume-1703bdb8-4d83-4395-91a7-863cb92abbe9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642441aa-5725-4a89-aea5-bd3c47a8eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642441aa-5725-4a89-aea5-bd3c47a8eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8599c9-e381-44f5-a1e2-008d3631abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Volume 1703bdb8-4d83-4395-91a7-863cb92abbe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1703bdb8-4d83-4395-91a7-863cb92abbe9', 'volume_size': 1}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e07d41f-3da7-49fe-9d4a-f9766e0f09c9,created_at=2026-04-20T21:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212893714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e07d41f-3da7-49fe-9d4a-f9766e0f09c9,host='devstack@QuobyteHD#QuobyteHD',id=1703bdb8-4d83-4395-91a7-863cb92abbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c87a8dd7226481d9532fe31650a4b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:34Z,use_quota=True,user_id='84904c64df8a4c1b86d06634a715cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d18c4ee-eef9-4e8f-b7d3-419659bee568),volume_type_id=2d18c4ee-eef9-4e8f-b7d3-419659bee568)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Creating volume 1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:33 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:33 devstack sudo[86406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 1073741824
Apr 20 23:37:33 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:34 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 1073741824" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:34 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9
Apr 20 23:37:34 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:34 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8599c9-e381-44f5-a1e2-008d3631abd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1703bdb8-4d83-4395-91a7-863cb92abbe9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b5a452-254d-4d96-9fc9-98bbfd145107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Volume volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 (1703bdb8-4d83-4395-91a7-863cb92abbe9): created successfully
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b5a452-254d-4d96-9fc9-98bbfd145107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Flow 'volume_create_manager' (75606b34-db7e-4c79-93de-823bc1e2c581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Flow 'volume_create_manager' (c75f15da-8a81-4383-9c25-8b9f1c8fff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c8b2af-ae01-4b8f-bee1-d2d790a75998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c8b2af-ae01-4b8f-bee1-d2d790a75998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-602446406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621d95f9-1528-4244-8750-97efb7a4226e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725802f40d074c95937a0982d442bf3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:35Z,use_quota=True,user_id='e37b31a2a4114cafa4871f6e3f533197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3228461b-4f32-4ecc-926f-0138b974c779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3228461b-4f32-4ecc-926f-0138b974c779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f1f347-6474-4950-b945-daff202f5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f1f347-6474-4950-b945-daff202f5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621d95f9-1528-4244-8750-97efb7a4226e', 'volume_name': 'volume-621d95f9-1528-4244-8750-97efb7a4226e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8406fc31-96e9-4f51-b3fd-4581d756e4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8406fc31-96e9-4f51-b3fd-4581d756e4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9eae41-3bb6-44b5-9bac-4b9101cb1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Volume 621d95f9-1528-4244-8750-97efb7a4226e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621d95f9-1528-4244-8750-97efb7a4226e', 'volume_size': 1}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-602446406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621d95f9-1528-4244-8750-97efb7a4226e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725802f40d074c95937a0982d442bf3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:35Z,use_quota=True,user_id='e37b31a2a4114cafa4871f6e3f533197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Creating volume 621d95f9-1528-4244-8750-97efb7a4226e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:34 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5dd7e071-839b-4198-a5d1-3b18ed7a20d1 tempest-GroupSnapshotsTest-571251773 None] Created volume successfully.
Apr 20 23:37:34 devstack sudo[86417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e 1073741824
Apr 20 23:37:34 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:35 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e 1073741824" returned: 0 in 0.568s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:35 devstack sudo[86423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e
Apr 20 23:37:35 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9913e37f-9670-40d0-8b71-010f096c1334 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Terminate volume connection completed successfully.
Apr 20 23:37:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9913e37f-9670-40d0-8b71-010f096c1334 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Deleting attachment 238494fe-cc8c-49b8-949e-375d7072535b. {{(pid=82641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 23:37:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] GroupSnapshot 8647744f-5b79-4b09-ad58-e8b2d3b7d47d: creating.
Apr 20 23:37:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Group snapshot 8647744f-5b79-4b09-ad58-e8b2d3b7d47d: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 23:37:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:36 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.096s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9eae41-3bb6-44b5-9bac-4b9101cb1c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621d95f9-1528-4244-8750-97efb7a4226e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b0849b-6916-4c61-b426-3b56bc8c5fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Creating offline snapshot bc843025-f9af-4fd2-908d-055b7eb3de20 of volume 1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:37:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Volume volume-621d95f9-1528-4244-8750-97efb7a4226e (621d95f9-1528-4244-8750-97efb7a4226e): created successfully
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b0849b-6916-4c61-b426-3b56bc8c5fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Flow 'volume_create_manager' (c75f15da-8a81-4383-9c25-8b9f1c8fff47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[900bb180-19ba-4b16-aa76-2d566735a8cf]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bda540cc-430f-4c71-a98a-d7f6b93993b0 tempest-VolumesServicesTestJSON-685273523 None] Created volume successfully.
Apr 20 23:37:36 devstack sudo[86426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9
Apr 20 23:37:36 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "cinder-5e520fc1-be4b-4238-98b5-ca4183ffea41-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-5e520fc1-be4b-4238-98b5-ca4183ffea41-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "cinder-quobyte-5e520fc1-be4b-4238-98b5-ca4183ffea41" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-quobyte-5e520fc1-be4b-4238-98b5-ca4183ffea41" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066f644-ab2f-431c-8636-9254a635c517]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:36 devstack sudo[86428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:37:36 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:36 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9" returned: 0 in 0.558s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:36 devstack sudo[86433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 1G
Apr 20 23:37:36 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:36 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:36 devstack sudo[86437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:37:36 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Acquiring lock "cinder-621d95f9-1528-4244-8750-97efb7a4226e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Lock "cinder-621d95f9-1528-4244-8750-97efb7a4226e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Acquiring lock "cinder-quobyte-621d95f9-1528-4244-8750-97efb7a4226e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Lock "cinder-quobyte-621d95f9-1528-4244-8750-97efb7a4226e" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[57654723-9bcf-4b9d-bf80-e0f88f61fbe0]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:37 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 1G" returned: 0 in 0.685s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:37 devstack sudo[86443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20
Apr 20 23:37:37 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:37 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e
Apr 20 23:37:37 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:37 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 1 in 0.673s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:37 devstack sudo[86450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41
Apr 20 23:37:37 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Flow 'volume_create_manager' (6785de0b-0180-4875-907c-36138a979e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f696b9c8-9582-4a56-8319-5dde27583bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f696b9c8-9582-4a56-8319-5dde27583bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-475760406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d76c56-f19f-49e1-8867-5d403646aea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbac807e61d40228232ae86f0ad4068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:38Z,use_quota=True,user_id='21e5680da7f1469f8a9d3309a6f1d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e950175-0f64-4112-b0b0-d1e8f0599243),volume_type_id=0e950175-0f64-4112-b0b0-d1e8f0599243)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a287cae-b479-49dc-a4dc-f32850c78740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a287cae-b479-49dc-a4dc-f32850c78740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785074a4-8948-46e8-8f06-bae66ffedf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785074a4-8948-46e8-8f06-bae66ffedf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d76c56-f19f-49e1-8867-5d403646aea1', 'volume_name': 'volume-a3d76c56-f19f-49e1-8867-5d403646aea1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb63066-e300-442d-b982-ddf4361225a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb63066-e300-442d-b982-ddf4361225a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b4ead6-510a-4def-870c-5e9cf8da76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Volume a3d76c56-f19f-49e1-8867-5d403646aea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d76c56-f19f-49e1-8867-5d403646aea1', 'volume_size': 1}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:37 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:37 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:37 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20
Apr 20 23:37:37 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:37 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:37 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e
Apr 20 23:37:37 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:38 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5e520fc1-be4b-4238-98b5-ca4183ffea41" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-quobyte-5e520fc1-be4b-4238-98b5-ca4183ffea41" released by "delete_volume" :: held 1.714s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.quota [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Created reservations ['1ebdec3d-c981-4a6e-a611-5fc9da4d13bc', '7711b6b3-5f6b-475b-9a10-855e52631384', 'e6971e8f-1151-4b2e-9d77-f0c6e8bfa895', 'c6b6599a-874e-443a-b897-aa642ab9a492'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:38 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:38 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:38 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:38 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info
Apr 20 23:37:38 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:38 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-621d95f9-1528-4244-8750-97efb7a4226e" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Lock "cinder-quobyte-621d95f9-1528-4244-8750-97efb7a4226e" released by "delete_volume" :: held 1.018s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Created reservations ['bab38228-26cb-4d79-b5b2-5c6d702d71d8', '445772c0-3cf7-44bf-983e-e1213470146c', 'a65dcfc2-e66b-4340-9652-fe2292ad6aa3', 'a0680ffc-02a4-4cde-a109-241940374db8'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:38 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:38 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:38 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.manager [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Deleted volume successfully.
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-27d5dd32-7cd3-44da-8b54-a84ebb5458fc req-9f738e32-3b4b-41bb-92d7-64bbfdce87e0 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-5e520fc1-be4b-4238-98b5-ca4183ffea41-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:38 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:38 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:38 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info
Apr 20 23:37:38 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:38 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Deleted volume successfully.
Apr 20 23:37:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e729f46-5386-47d7-9880-8c0ca9123d91 tempest-VolumesServicesTestJSON-685273523 None] Lock "cinder-621d95f9-1528-4244-8750-97efb7a4226e-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:39 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.info" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.179s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-475760406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d76c56-f19f-49e1-8867-5d403646aea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbac807e61d40228232ae86f0ad4068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:38Z,use_quota=True,user_id='21e5680da7f1469f8a9d3309a6f1d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e950175-0f64-4112-b0b0-d1e8f0599243),volume_type_id=0e950175-0f64-4112-b0b0-d1e8f0599243)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Creating volume a3d76c56-f19f-49e1-8867-5d403646aea1 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:39 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:39 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1 1073741824
Apr 20 23:37:39 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d282fd68-8191-4efe-9423-9c2c5db6d73d tempest-GroupSnapshotsTest-571251773 None] group_snapshot 8647744f-5b79-4b09-ad58-e8b2d3b7d47d: created successfully
Apr 20 23:37:39 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1 1073741824" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:39 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1
Apr 20 23:37:39 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] group_snapshot 8647744f-5b79-4b09-ad58-e8b2d3b7d47d: deleting
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] group_snapshot 8647744f-5b79-4b09-ad58-e8b2d3b7d47d: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-1703bdb8-4d83-4395-91a7-863cb92abbe9" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1703bdb8-4d83-4395-91a7-863cb92abbe9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-bc843025-f9af-4fd2-908d-055b7eb3de20" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-bc843025-f9af-4fd2-908d-055b7eb3de20" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Deleting offline snapshot bc843025-f9af-4fd2-908d-055b7eb3de20 of volume 1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:37:40 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] snapshot_file for this snap is: volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1" returned: 0 in 0.558s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[127649af-8e5f-466d-8656-8bfb6fd7a415]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b4ead6-510a-4def-870c-5e9cf8da76dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d76c56-f19f-49e1-8867-5d403646aea1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8971386-0e61-4f86-8aea-fe0fbff91482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:40 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Volume volume-a3d76c56-f19f-49e1-8867-5d403646aea1 (a3d76c56-f19f-49e1-8867-5d403646aea1): created successfully
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8971386-0e61-4f86-8aea-fe0fbff91482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Flow 'volume_create_manager' (6785de0b-0180-4875-907c-36138a979e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-084426a4-b344-4d94-a30b-31190a13af70 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Created volume successfully.
Apr 20 23:37:40 devstack sudo[86486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20
Apr 20 23:37:40 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:41 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20" returned: 0 in 0.711s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1703bdb8-4d83-4395-91a7-863cb92abbe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:37:41 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:41 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[425879ee-43a1-4101-929f-ead249b2e376]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:41 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9
Apr 20 23:37:41 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:41 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.573s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a899a426-cc1f-4ad9-996b-016c80d51fb6 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Retype volume completed successfully.
Apr 20 23:37:41 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9" returned: 0 in 0.582s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:41 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20
Apr 20 23:37:41 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:42 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:42 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20
Apr 20 23:37:42 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Acquiring lock "cinder-a3d76c56-f19f-49e1-8867-5d403646aea1-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "cinder-a3d76c56-f19f-49e1-8867-5d403646aea1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Acquiring lock "cinder-quobyte-a3d76c56-f19f-49e1-8867-5d403646aea1" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "cinder-quobyte-a3d76c56-f19f-49e1-8867-5d403646aea1" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a598b2-b1d9-40f1-80dd-2fe290b941a8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:42 devstack sudo[86537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1
Apr 20 23:37:42 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:42 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9.bc843025-f9af-4fd2-908d-055b7eb3de20" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-bc843025-f9af-4fd2-908d-055b7eb3de20" released by "_delete_snapshot" :: held 2.422s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1703bdb8-4d83-4395-91a7-863cb92abbe9" released by "delete_snapshot" :: held 2.433s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:42 devstack cinder-volume[82641]: WARNING cinder.quota [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1791967255 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1791967255, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:42 devstack cinder-volume[82641]: WARNING cinder.quota [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1791967255 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1791967255, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:42 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] Created reservations ['cacaf424-566e-4cd4-84bf-5452c7ae88cc', '9e08e8ef-48bf-414a-a959-9aae3491a068', 'db7d7a39-b241-4a74-befb-69dfd10f5937', '5470e7fc-8134-406d-958d-4caa5a3c5a22'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a42c0fac-56df-4ad2-917b-5d9af01e1ced tempest-GroupSnapshotsTest-571251773 None] group_snapshot 8647744f-5b79-4b09-ad58-e8b2d3b7d47d: deleted successfully
Apr 20 23:37:43 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1" returned: 0 in 0.556s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:43 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1
Apr 20 23:37:43 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Flow 'volume_create_manager' (151a702e-cfcb-4be6-b9df-b685172834df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f81d275-03eb-440c-a528-afd09b5d72d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f81d275-03eb-440c-a528-afd09b5d72d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2082636374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73dec30-704a-4513-b809-f97860f867e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab646d96bba5464dbf32a032a3b1ad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:43Z,use_quota=True,user_id='5325a2bee4014aaf8d3bf8fd58a1f5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c813da41-10bd-4f94-8501-837c9e8ef771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c813da41-10bd-4f94-8501-837c9e8ef771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36e9499-b7fd-4f05-bb76-f5d81b86fed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36e9499-b7fd-4f05-bb76-f5d81b86fed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73dec30-704a-4513-b809-f97860f867e4', 'volume_name': 'volume-c73dec30-704a-4513-b809-f97860f867e4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e2a403-d616-4ed9-81cc-4aab673472e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e2a403-d616-4ed9-81cc-4aab673472e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33c72b8-0896-4b35-b7f5-f1fb3aeb42b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Volume c73dec30-704a-4513-b809-f97860f867e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73dec30-704a-4513-b809-f97860f867e4', 'volume_size': 1}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2082636374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73dec30-704a-4513-b809-f97860f867e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab646d96bba5464dbf32a032a3b1ad70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:43Z,use_quota=True,user_id='5325a2bee4014aaf8d3bf8fd58a1f5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Creating volume c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:43 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:43 devstack sudo[86546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 1073741824
Apr 20 23:37:43 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:43 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a3d76c56-f19f-49e1-8867-5d403646aea1" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "cinder-quobyte-a3d76c56-f19f-49e1-8867-5d403646aea1" released by "delete_volume" :: held 1.023s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:43 devstack cinder-volume[82641]: WARNING cinder.quota [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:43 devstack cinder-volume[82641]: WARNING cinder.quota [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Created reservations ['4d27056e-3e42-4226-8e63-20b5d1230f0f', 'db6a2184-f28c-4ce2-89fc-3c2cc8a18816', '6ae4597e-ca70-4a48-b807-47be592cd81c', '65ccc59e-eb9c-4b6a-b7c1-2ceb01bf199b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:43 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:43 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "cinder-quobyte-1703bdb8-4d83-4395-91a7-863cb92abbe9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1703bdb8-4d83-4395-91a7-863cb92abbe9" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[832af61d-3cc1-4dc8-8ef8-b550281d2949]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:43 devstack sudo[86554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9
Apr 20 23:37:43 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:43 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 1073741824" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:43 devstack sudo[86556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4
Apr 20 23:37:43 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:44 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Deleted volume successfully.
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe8be0f3-f604-4411-bee9-2f521fbba7f5 tempest-VolumeRetypeWithoutMigrationTest-79940913 None] Lock "cinder-a3d76c56-f19f-49e1-8867-5d403646aea1-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:44 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:44 devstack sudo[86563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9
Apr 20 23:37:44 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:44 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4" returned: 0 in 0.428s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33c72b8-0896-4b35-b7f5-f1fb3aeb42b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73dec30-704a-4513-b809-f97860f867e4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9e7fa1-19d1-4561-adde-fd97f45b3746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Volume volume-c73dec30-704a-4513-b809-f97860f867e4 (c73dec30-704a-4513-b809-f97860f867e4): created successfully
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9e7fa1-19d1-4561-adde-fd97f45b3746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Flow 'volume_create_manager' (151a702e-cfcb-4be6-b9df-b685172834df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-948e024c-8108-4987-95db-4803b2c1261f tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Created volume successfully.
Apr 20 23:37:44 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1703bdb8-4d83-4395-91a7-863cb92abbe9" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Lock "cinder-quobyte-1703bdb8-4d83-4395-91a7-863cb92abbe9" released by "delete_volume" :: held 0.988s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Created reservations ['3b795647-cf59-4012-8368-cf90ba1c5588'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:44 devstack cinder-volume[82641]: WARNING cinder.quota [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1791967255 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1791967255, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Created reservations ['c7bd07e8-1382-400c-8300-f5e0e34415ec', '50079ba8-a205-4bd2-8b1f-3f64bde0177f', '609685bc-1205-49e6-a78f-554301ba7115', '94d9c9a5-a4f2-480c-b422-14bf17f1622d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:44 devstack sudo[86566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:44 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:45 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a0f80524-50cc-4b74-b2f1-00cf75042f4f tempest-GroupSnapshotsTest-571251773 None] Delete group completed successfully.
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Creating offline snapshot e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff of volume c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2481bb02-10db-4f9b-956c-ab88a7333e39]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:45 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4
Apr 20 23:37:45 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:46 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4" returned: 0 in 0.623s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:46 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff 1G
Apr 20 23:37:46 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:46 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff 1G" returned: 0 in 0.621s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73dec30-704a-4513-b809-f97860f867e4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:46 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73dec30-704a-4513-b809-f97860f867e4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff
Apr 20 23:37:46 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:47 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73dec30-704a-4513-b809-f97860f867e4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" returned: 0 in 0.682s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:47 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff is being set with open permissions: ugo+rw
Apr 20 23:37:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:47 devstack sudo[86608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff
Apr 20 23:37:47 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:48 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" returned: 0 in 0.599s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:48 devstack sudo[86614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info
Apr 20 23:37:48 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:48 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info" returned: 0 in 0.642s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:48 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info is being set with open permissions: ugo+rw
Apr 20 23:37:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:48 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info
Apr 20 23:37:48 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:49 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.info" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.748s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-213b8bb1-ecc0-4fb7-b6c3-f8b11c7ff70e tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Create snapshot completed successfully
Apr 20 23:37:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-9783a47d-4a1a-4573-8d9e-36f340e38869 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Terminate volume connection completed successfully.
Apr 20 23:37:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-9783a47d-4a1a-4573-8d9e-36f340e38869 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Deleting attachment 9eddf62c-ccf6-40b3-93c7-6db7b389510c. {{(pid=82641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "cinder-3b95812e-91dd-4775-a149-ae188f280b00-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-3b95812e-91dd-4775-a149-ae188f280b00-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "cinder-quobyte-3b95812e-91dd-4775-a149-ae188f280b00" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "cinder-e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-quobyte-3b95812e-91dd-4775-a149-ae188f280b00" acquired by "delete_volume" :: waited 0.031s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "cinder-quobyte-c73dec30-704a-4513-b809-f97860f867e4" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835009e-494e-446d-a9ff-d083d6a8d7da]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-quobyte-c73dec30-704a-4513-b809-f97860f867e4" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "cinder-quobyte-e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-337d8d12-d1c2-4668-be63-6c879bf9d53c tempest-GroupSnapshotsV319Test-1561846680 None] Group tempest-GroupSnapshotsV319Test-Group-1105737189: creating
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-quobyte-e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Deleting offline snapshot e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff of volume c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] snapshot_file for this snap is: volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046009b-4029-44ad-93f2-eaced0b354c7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:50 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00
Apr 20 23:37:50 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-337d8d12-d1c2-4668-be63-6c879bf9d53c tempest-GroupSnapshotsV319Test-1561846680 None] Group tempest-GroupSnapshotsV319Test-Group-1105737189: created successfully
Apr 20 23:37:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-337d8d12-d1c2-4668-be63-6c879bf9d53c tempest-GroupSnapshotsV319Test-1561846680 None] Create group completed successfully.
Apr 20 23:37:50 devstack sudo[86624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff
Apr 20 23:37:50 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:50 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:50 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00
Apr 20 23:37:50 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:50 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73dec30-704a-4513-b809-f97860f867e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab6df6-7968-4646-93e0-6d8e50d4ad45]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:51 devstack sudo[86637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4
Apr 20 23:37:51 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:51 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3b95812e-91dd-4775-a149-ae188f280b00" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-quobyte-3b95812e-91dd-4775-a149-ae188f280b00" released by "delete_volume" :: held 1.161s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.quota [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Created reservations ['1797d2e4-841d-4dc1-ab31-230602aff443', 'acf57bef-4e54-43dd-ae41-c011dd1d50d2', '36392029-4e9e-43f8-9f35-a90914c9ad6e', '53161c11-21d5-4998-a647-037f1768bd4b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:51 devstack sudo[86644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:51 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:51 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4" returned: 0 in 0.626s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:51 devstack sudo[86646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff
Apr 20 23:37:51 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Flow 'volume_create_manager' (c786a425-8d56-4ded-b9d8-88399537a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51288af7-8727-4f4c-a5ad-c50b9cdcb710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51288af7-8727-4f4c-a5ad-c50b9cdcb710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1193486003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a027659e-4d43-4717-a314-67ef653b5591,host='devstack@QuobyteHD#QuobyteHD',id=f716358e-9cbe-4609-a315-8a9a23ec4d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6afff98a2d840e08c531a0159b5600e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:52Z,use_quota=True,user_id='5922d6dc7bb34c3eb383368cbefd35ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1393f881-3181-486e-9e06-d2e96adc4e0a),volume_type_id=1393f881-3181-486e-9e06-d2e96adc4e0a)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75159f37-e1c7-432e-b0d5-3139b8c04e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75159f37-e1c7-432e-b0d5-3139b8c04e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df77f125-bc19-4d2a-8704-cbf53e6c71ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df77f125-bc19-4d2a-8704-cbf53e6c71ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f716358e-9cbe-4609-a315-8a9a23ec4d00', 'volume_name': 'volume-f716358e-9cbe-4609-a315-8a9a23ec4d00', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fd7e7-6031-439c-b259-844e2cf60c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5fd7e7-6031-439c-b259-844e2cf60c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beec3fd3-509d-4526-b04e-cd973377782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Volume f716358e-9cbe-4609-a315-8a9a23ec4d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f716358e-9cbe-4609-a315-8a9a23ec4d00', 'volume_size': 1}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a027659e-4d43-4717-a314-67ef653b5591,created_at=2026-04-20T21:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1193486003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a027659e-4d43-4717-a314-67ef653b5591,host='devstack@QuobyteHD#QuobyteHD',id=f716358e-9cbe-4609-a315-8a9a23ec4d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6afff98a2d840e08c531a0159b5600e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:52Z,use_quota=True,user_id='5922d6dc7bb34c3eb383368cbefd35ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1393f881-3181-486e-9e06-d2e96adc4e0a),volume_type_id=1393f881-3181-486e-9e06-d2e96adc4e0a)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Creating volume f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:51 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:51 devstack sudo[86648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 1073741824
Apr 20 23:37:51 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:52 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.manager [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Deleted volume successfully.
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-169adcd6-7be4-4571-8b8f-ee1a8b47ad11 req-67fc70b2-1dd3-474e-8ce3-09b2ee317303 tempest-ServerBootFromVolumeStableRescueTest-1860032857 None] Lock "cinder-3b95812e-91dd-4775-a149-ae188f280b00-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:52 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:52 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff
Apr 20 23:37:52 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:52 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 1073741824" returned: 0 in 0.684s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:52 devstack sudo[86659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00
Apr 20 23:37:52 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:52 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4.e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-quobyte-e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff" released by "_delete_snapshot" :: held 2.298s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-quobyte-c73dec30-704a-4513-b809-f97860f867e4" released by "delete_snapshot" :: held 2.313s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Created reservations ['1f6a2001-2368-4580-a7ba-b6ad556eba87', '3a630c93-db56-468b-ba36-cc0d9e751b0e', 'b7d19aaa-7711-4ce4-aced-09b213e133d3', 'e7e89ca8-1346-4831-87a0-493f67f2f844'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Delete snapshot completed successfully.
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-63d6ffb2-57ae-43d6-b215-b71e6eb1fce3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-e1d25f83-f28c-4cb5-ae5b-48e5a620c5ff-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:52 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beec3fd3-509d-4526-b04e-cd973377782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f716358e-9cbe-4609-a315-8a9a23ec4d00', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2903f23-ddfd-452f-89d3-fa996cb8e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Volume volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 (f716358e-9cbe-4609-a315-8a9a23ec4d00): created successfully
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2903f23-ddfd-452f-89d3-fa996cb8e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Flow 'volume_create_manager' (c786a425-8d56-4ded-b9d8-88399537a770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b08a81e1-ad34-47e8-9423-80a62157f546 tempest-GroupSnapshotsV319Test-1561846680 None] Created volume successfully.
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "cinder-c73dec30-704a-4513-b809-f97860f867e4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-c73dec30-704a-4513-b809-f97860f867e4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "cinder-quobyte-c73dec30-704a-4513-b809-f97860f867e4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-quobyte-c73dec30-704a-4513-b809-f97860f867e4" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[90860f95-689e-4421-b68d-f1e3fc5586f4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:53 devstack sudo[86664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4
Apr 20 23:37:53 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] GroupSnapshot be048863-4b32-44d9-b5f3-1afc80d1aef1: creating.
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Group snapshot be048863-4b32-44d9-b5f3-1afc80d1aef1: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Creating offline snapshot a77cb031-9d09-433a-856f-772068f7dc46 of volume f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40be11-73d1-4372-af98-a436b449d692]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:54 devstack sudo[86669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00
Apr 20 23:37:54 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:54 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:54 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4
Apr 20 23:37:54 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:54 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c73dec30-704a-4513-b809-f97860f867e4" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:54 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00" returned: 0 in 0.618s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-quobyte-c73dec30-704a-4513-b809-f97860f867e4" released by "delete_volume" :: held 1.138s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:54 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 1G
Apr 20 23:37:54 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Created reservations ['35981967-8588-435d-bcee-cb85539d2d30', '942e0dfa-86bd-4d94-ac8c-6b847ef42b94', 'b7cf706c-6751-496b-8a1c-c11dc2cdb775', '943d02fe-2fbf-4768-807f-307acabd3f88'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:54 devstack sudo[86705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:37:54 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:55 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 1G" returned: 0 in 0.649s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:55 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46
Apr 20 23:37:55 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:55 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.617s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:37:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Deleted volume successfully.
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5fe6fdfa-fabd-4a6a-a32f-63a56ba47b46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1178522399 None] Lock "cinder-c73dec30-704a-4513-b809-f97860f867e4-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:37:55 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:55 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:55 devstack sudo[86718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46
Apr 20 23:37:55 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:56 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:56 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info
Apr 20 23:37:56 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:56 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info" returned: 0 in 0.582s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:56 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:37:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:56 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info
Apr 20 23:37:56 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:57 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.info" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.484s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b7a38a21-8db6-4cf6-ac62-c99a51a53bec tempest-GroupSnapshotsV319Test-1561846680 None] group_snapshot be048863-4b32-44d9-b5f3-1afc80d1aef1: created successfully
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Flow 'volume_create_manager' (36f80862-c224-4c8b-8066-8f1deeb92796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1791d279-a54c-4ebd-8680-9aae8f1e32c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1791d279-a54c-4ebd-8680-9aae8f1e32c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1615766929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac7c56d959c486e9e17f9c7134b5013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:58Z,use_quota=True,user_id='98ccd0721b68435ea9f8d6c39a8bd8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d8ae03-99ba-4f82-a3d0-b1d5397514bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d8ae03-99ba-4f82-a3d0-b1d5397514bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74816d8-7f56-4d2c-b3c4-0b386c3d6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74816d8-7f56-4d2c-b3c4-0b386c3d6d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4', 'volume_name': 'volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5581cda4-f6f3-4072-9378-816b4a89e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5581cda4-f6f3-4072-9378-816b4a89e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9e036b-e72d-466b-821e-7f32925a39dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Volume e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4', 'volume_size': 1}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1615766929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac7c56d959c486e9e17f9c7134b5013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:37:58Z,use_quota=True,user_id='98ccd0721b68435ea9f8d6c39a8bd8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Creating volume e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:37:58 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:58 devstack sudo[86729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 1073741824
Apr 20 23:37:58 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] group_snapshot be048863-4b32-44d9-b5f3-1afc80d1aef1: deleting
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] group_snapshot be048863-4b32-44d9-b5f3-1afc80d1aef1: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "cinder-quobyte-f716358e-9cbe-4609-a315-8a9a23ec4d00" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "cinder-quobyte-f716358e-9cbe-4609-a315-8a9a23ec4d00" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "cinder-quobyte-a77cb031-9d09-433a-856f-772068f7dc46" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "cinder-quobyte-a77cb031-9d09-433a-856f-772068f7dc46" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Deleting offline snapshot a77cb031-9d09-433a-856f-772068f7dc46 of volume f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] snapshot_file for this snap is: volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ecc30-c367-47fe-95b0-8fc735610cb8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:58 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46
Apr 20 23:37:58 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:59 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 1073741824" returned: 0 in 0.650s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:59 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4
Apr 20 23:37:59 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:59 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f716358e-9cbe-4609-a315-8a9a23ec4d00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bea3f8-83cb-4c74-bc39-12afdd89df89]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:59 devstack sudo[86741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00
Apr 20 23:37:59 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:37:59 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9e036b-e72d-466b-821e-7f32925a39dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ca0ac2-9792-4a3b-8a7a-6de6db948e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:37:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Volume volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 (e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4): created successfully
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ca0ac2-9792-4a3b-8a7a-6de6db948e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Flow 'volume_create_manager' (36f80862-c224-4c8b-8066-8f1deeb92796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:37:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e0e9a8c7-105d-41bf-bdbe-82bcf7020889 tempest-SnapshotMetadataTestJSON-1956514516 None] Created volume successfully.
Apr 20 23:37:59 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00" returned: 0 in 0.560s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:37:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:37:59 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46
Apr 20 23:37:59 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:00 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46" returned: 0 in 0.572s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:00 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46
Apr 20 23:38:00 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Creating offline snapshot 91082082-3722-4c17-bf46-fdaefaa41787 of volume e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2151bbb-1ba9-4cb5-b0da-628cced0bba7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:00 devstack sudo[86754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4
Apr 20 23:38:00 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:00 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00.a77cb031-9d09-433a-856f-772068f7dc46" returned: 0 in 0.553s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "cinder-quobyte-a77cb031-9d09-433a-856f-772068f7dc46" released by "_delete_snapshot" :: held 2.297s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "cinder-quobyte-f716358e-9cbe-4609-a315-8a9a23ec4d00" released by "delete_snapshot" :: held 2.322s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Flow 'volume_create_manager' (2edeb2c2-67c3-4ae4-ba2e-48e5aeafd030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3acf69d3-a345-41ac-a484-b37ac4482e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3acf69d3-a345-41ac-a484-b37ac4482e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-444165106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e721027a-b518-47de-9ac3-1420db902764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27088304dc549eabd174e1a837c4f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:01Z,use_quota=True,user_id='1d7cd011281c4ae0bb1d1295935810fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82492211-f9e8-4fa6-8863-b4707b8c8996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82492211-f9e8-4fa6-8863-b4707b8c8996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30052521-5a42-44a7-b8e7-03a3bf17f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30052521-5a42-44a7-b8e7-03a3bf17f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e721027a-b518-47de-9ac3-1420db902764', 'volume_name': 'volume-e721027a-b518-47de-9ac3-1420db902764', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd1dac5-ba7d-42f4-b752-68dad57edf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd1dac5-ba7d-42f4-b752-68dad57edf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcd8d9d-2a23-4235-a3f1-038c87012079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Volume e721027a-b518-47de-9ac3-1420db902764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e721027a-b518-47de-9ac3-1420db902764', 'volume_size': 1}
Apr 20 23:38:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:00 devstack cinder-volume[82641]: WARNING cinder.quota [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-871182341 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-871182341, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:00 devstack cinder-volume[82641]: WARNING cinder.quota [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-871182341 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-871182341, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] Created reservations ['c037ea49-c85b-4ab6-993a-aaaa8b21214c', 'ac2a05ac-edfd-4325-a7f2-ec6b4b5cd88d', 'f1203892-35cd-4705-80f1-67c74b4c922d', 'e341484a-1309-436c-a06d-f0856816c24e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2bb7af79-2956-4fad-8aa1-31a6706d77a4 tempest-GroupSnapshotsV319Test-1561846680 None] group_snapshot be048863-4b32-44d9-b5f3-1afc80d1aef1: deleted successfully
Apr 20 23:38:01 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" returned: 0 in 0.617s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:01 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 1G
Apr 20 23:38:01 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:01 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 1G" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:01 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787
Apr 20 23:38:01 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "cinder-quobyte-f716358e-9cbe-4609-a315-8a9a23ec4d00" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "cinder-quobyte-f716358e-9cbe-4609-a315-8a9a23ec4d00" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b6b05-05e4-42c6-82a7-24ef8ff8a472]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:02 devstack sudo[86768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00
Apr 20 23:38:02 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:02 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787" returned: 0 in 0.559s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:02 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 is being set with open permissions: ugo+rw
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:02 devstack sudo[86777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787
Apr 20 23:38:02 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:02 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:02 devstack sudo[86779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00
Apr 20 23:38:02 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:02 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:02 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info
Apr 20 23:38:02 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:02 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f716358e-9cbe-4609-a315-8a9a23ec4d00" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "cinder-quobyte-f716358e-9cbe-4609-a315-8a9a23ec4d00" released by "delete_volume" :: held 1.038s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Created reservations ['fbf68cbb-095c-4cd3-98ac-8a58c4095292'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:03 devstack cinder-volume[82641]: WARNING cinder.quota [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-871182341 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-871182341, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Created reservations ['29ac2547-d1f3-4c05-a5f8-8facf141b5f9', '113636ad-e463-4058-ae0e-ece6e6169651', '3f17c644-f38d-454f-92c6-f789e12e667e', '139bbdad-0f43-4b4c-b4f6-9ec7759c5480'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:03 devstack sudo[86785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:03 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:03 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:03 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info is being set with open permissions: ugo+rw
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:03 devstack sudo[86788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info
Apr 20 23:38:03 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:03 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-16516398-e594-4782-9366-522db411ab99 tempest-GroupSnapshotsV319Test-1561846680 None] Delete group completed successfully.
Apr 20 23:38:03 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.info" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.833s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-444165106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e721027a-b518-47de-9ac3-1420db902764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27088304dc549eabd174e1a837c4f57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:01Z,use_quota=True,user_id='1d7cd011281c4ae0bb1d1295935810fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Creating volume e721027a-b518-47de-9ac3-1420db902764 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:03 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:03 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764 1073741824
Apr 20 23:38:03 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2604e389-bce8-4be7-b738-d0270569a770 tempest-SnapshotMetadataTestJSON-1956514516 None] Create snapshot completed successfully
Apr 20 23:38:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7ec42006-4576-4e3d-9963-33350c9f79b3 tempest-GroupsTest-1313173978 None] Group tempest-Group1-1274253453: creating
Apr 20 23:38:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7ec42006-4576-4e3d-9963-33350c9f79b3 tempest-GroupsTest-1313173978 None] Group tempest-Group1-1274253453: created successfully
Apr 20 23:38:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7ec42006-4576-4e3d-9963-33350c9f79b3 tempest-GroupsTest-1313173978 None] Create group completed successfully.
Apr 20 23:38:04 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764 1073741824" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:04 devstack sudo[86797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764
Apr 20 23:38:04 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:04 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcd8d9d-2a23-4235-a3f1-038c87012079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e721027a-b518-47de-9ac3-1420db902764', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e897acd-3fd3-44e6-8a64-fb630dded156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:04 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Volume volume-e721027a-b518-47de-9ac3-1420db902764 (e721027a-b518-47de-9ac3-1420db902764): created successfully
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e897acd-3fd3-44e6-8a64-fb630dded156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Flow 'volume_create_manager' (2edeb2c2-67c3-4ae4-ba2e-48e5aeafd030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bfeb5fce-e409-48e5-ad9e-98956c651321 tempest-AbsoluteLimitsTests-543036072 None] Created volume successfully.
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Acquiring lock "cinder-e721027a-b518-47de-9ac3-1420db902764-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Lock "cinder-e721027a-b518-47de-9ac3-1420db902764-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Acquiring lock "cinder-quobyte-e721027a-b518-47de-9ac3-1420db902764" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Lock "cinder-quobyte-e721027a-b518-47de-9ac3-1420db902764" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd8860-c108-40c3-8190-4f956d8febd7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "cinder-91082082-3722-4c17-bf46-fdaefaa41787-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-91082082-3722-4c17-bf46-fdaefaa41787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "cinder-quobyte-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-quobyte-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "cinder-quobyte-91082082-3722-4c17-bf46-fdaefaa41787" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-quobyte-91082082-3722-4c17-bf46-fdaefaa41787" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Deleting offline snapshot 91082082-3722-4c17-bf46-fdaefaa41787 of volume e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] snapshot_file for this snap is: volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a65e81-0a37-4147-a378-826345aedd3a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:05 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764
Apr 20 23:38:05 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:05 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787
Apr 20 23:38:05 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-40df541d-38c7-484f-bd6b-fc2815ad37d8 tempest-GroupsTest-1313173978 None] Group tempest-Group2-287099930: creating
Apr 20 23:38:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-40df541d-38c7-484f-bd6b-fc2815ad37d8 tempest-GroupsTest-1313173978 None] Group tempest-Group2-287099930: created successfully
Apr 20 23:38:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-40df541d-38c7-484f-bd6b-fc2815ad37d8 tempest-GroupsTest-1313173978 None] Create group completed successfully.
Apr 20 23:38:05 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764" returned: 0 in 0.615s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:05 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787" returned: 0 in 0.556s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:05 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764
Apr 20 23:38:05 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a469cf7-272c-4b4d-87f1-d42473975e73]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:06 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4
Apr 20 23:38:06 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:06 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e721027a-b518-47de-9ac3-1420db902764" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Lock "cinder-quobyte-e721027a-b518-47de-9ac3-1420db902764" released by "delete_volume" :: held 1.137s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Created reservations ['2652dcda-3e6b-4726-a8eb-3de1b308c28a', '2df6e005-e9dd-4930-b90a-c095563a44e0', '53895f8f-ab19-4953-9755-612a6b58d880', 'ec4d4fcb-90b4-419e-885f-d5e4d8e6865a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:06 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:06 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787
Apr 20 23:38:06 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:06 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:06 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:06 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:06 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Flow 'volume_create_manager' (c2a65af9-39b9-4670-b264-2a25a924fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e424491a-58be-4eca-bb06-d695c2deca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:07 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e424491a-58be-4eca-bb06-d695c2deca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966261785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7129a8b0-b1fa-4027-af0e-a54db06d39b2,host='devstack@QuobyteHD#QuobyteHD',id=4fb8afdd-a60d-49a7-9e55-18ffd671795e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac715aeb49cd4836aeb550759a3a3710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:07Z,use_quota=True,user_id='61d845f8a3e64240932d58b58adddb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eca3181-a56a-401d-8962-2fca62c09142),volume_type_id=2eca3181-a56a-401d-8962-2fca62c09142)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91776b73-46d2-4075-a57f-d9c494c06c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91776b73-46d2-4075-a57f-d9c494c06c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2092a43-2b80-4af6-905d-ef0cdab70677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2092a43-2b80-4af6-905d-ef0cdab70677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb8afdd-a60d-49a7-9e55-18ffd671795e', 'volume_name': 'volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb7f9ac-e35c-4872-9f70-f8d22352787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb7f9ac-e35c-4872-9f70-f8d22352787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac7b899-8c7c-4396-9520-8f6461c8b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Volume 4fb8afdd-a60d-49a7-9e55-18ffd671795e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e', 'volume_size': 1}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7129a8b0-b1fa-4027-af0e-a54db06d39b2,created_at=2026-04-20T21:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966261785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7129a8b0-b1fa-4027-af0e-a54db06d39b2,host='devstack@QuobyteHD#QuobyteHD',id=4fb8afdd-a60d-49a7-9e55-18ffd671795e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac715aeb49cd4836aeb550759a3a3710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:07Z,use_quota=True,user_id='61d845f8a3e64240932d58b58adddb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eca3181-a56a-401d-8962-2fca62c09142),volume_type_id=2eca3181-a56a-401d-8962-2fca62c09142)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Creating volume 4fb8afdd-a60d-49a7-9e55-18ffd671795e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:07 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Deleted volume successfully.
Apr 20 23:38:07 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e 1073741824
Apr 20 23:38:07 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787" returned: 0 in 0.624s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8c3fc29b-5a64-4b41-8521-af12864afe30 tempest-AbsoluteLimitsTests-543036072 None] Lock "cinder-e721027a-b518-47de-9ac3-1420db902764-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:07 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787
Apr 20 23:38:07 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:07 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4.91082082-3722-4c17-bf46-fdaefaa41787" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-quobyte-91082082-3722-4c17-bf46-fdaefaa41787" released by "_delete_snapshot" :: held 2.167s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-quobyte-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" released by "delete_snapshot" :: held 2.192s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Created reservations ['d9c8c47b-ebd5-4ddf-bb3e-2da2ed8e97ff', '248e1cc2-a9f9-4a1b-b258-d3f788cc4cb2', '40d61945-b8ec-46e4-9dda-0c673207cd22', '65c2cdea-67c1-49ee-8c1b-ff3107a83eb4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:07 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e 1073741824" returned: 0 in 0.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Delete snapshot completed successfully.
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7ff250b8-e4d5-4ee7-bca2-76e1f674c751 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-91082082-3722-4c17-bf46-fdaefaa41787-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:07 devstack sudo[86835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e
Apr 20 23:38:07 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Flow 'volume_create_manager' (56d358c0-3098-4ed4-8371-2ba564da89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7240d0-df92-41c8-8c21-ba68ad534d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7240d0-df92-41c8-8c21-ba68ad534d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2002180282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685bff67-1be2-4387-918d-21d00ca9b1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47894404a1448c3b6ff5b5d57552930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:08Z,use_quota=True,user_id='9e24084138ba49ed861b90deaad47d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cba1e0d-2fbf-40b8-b52a-18bf2886a514),volume_type_id=9cba1e0d-2fbf-40b8-b52a-18bf2886a514)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd5c22-f066-4432-ae4b-f8a12121f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd5c22-f066-4432-ae4b-f8a12121f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fb232b-8ef9-41f3-abac-dd340b8a8d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fb232b-8ef9-41f3-abac-dd340b8a8d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685bff67-1be2-4387-918d-21d00ca9b1f8', 'volume_name': 'volume-685bff67-1be2-4387-918d-21d00ca9b1f8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b5dcb5-1dff-4b29-b909-84c48d8ce2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b5dcb5-1dff-4b29-b909-84c48d8ce2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8031d176-abc4-4a8b-a8cf-a22fffc73f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Volume 685bff67-1be2-4387-918d-21d00ca9b1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685bff67-1be2-4387-918d-21d00ca9b1f8', 'volume_size': 1}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:08 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e" returned: 0 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2002180282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685bff67-1be2-4387-918d-21d00ca9b1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47894404a1448c3b6ff5b5d57552930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:08Z,use_quota=True,user_id='9e24084138ba49ed861b90deaad47d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cba1e0d-2fbf-40b8-b52a-18bf2886a514),volume_type_id=9cba1e0d-2fbf-40b8-b52a-18bf2886a514)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Creating volume 685bff67-1be2-4387-918d-21d00ca9b1f8 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:08 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac7b899-8c7c-4396-9520-8f6461c8b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db869d41-9e4c-4385-b2fe-0092433dd1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:08 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8 1073741824
Apr 20 23:38:08 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Volume volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e (4fb8afdd-a60d-49a7-9e55-18ffd671795e): created successfully
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db869d41-9e4c-4385-b2fe-0092433dd1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Flow 'volume_create_manager' (c2a65af9-39b9-4670-b264-2a25a924fe49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ae92b23a-aece-4f21-b0eb-8f41cf1ac22d tempest-GroupsTest-1313173978 None] Created volume successfully.
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "cinder-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "cinder-quobyte-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-quobyte-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80c14b-9e1f-4033-9211-c3069d6e9ee9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:08 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4
Apr 20 23:38:08 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:08 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8 1073741824" returned: 0 in 0.595s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:08 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8
Apr 20 23:38:08 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:09 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:09 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4
Apr 20 23:38:09 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:09 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8031d176-abc4-4a8b-a8cf-a22fffc73f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685bff67-1be2-4387-918d-21d00ca9b1f8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f5a382-f6ea-4e0d-b745-c8211d1496ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Volume volume-685bff67-1be2-4387-918d-21d00ca9b1f8 (685bff67-1be2-4387-918d-21d00ca9b1f8): created successfully
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f5a382-f6ea-4e0d-b745-c8211d1496ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Flow 'volume_create_manager' (56d358c0-3098-4ed4-8371-2ba564da89c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a51bb0f6-ee8f-4f32-9e43-043776e22b63 tempest-VolumeTypesAccessTest-956214127 None] Created volume successfully.
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Acquiring lock "cinder-quobyte-4fb8afdd-a60d-49a7-9e55-18ffd671795e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Lock "cinder-quobyte-4fb8afdd-a60d-49a7-9e55-18ffd671795e" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b47b13-9893-4f88-9722-90479d4bf946]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:09 devstack sudo[86853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e
Apr 20 23:38:09 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:09 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-quobyte-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4" released by "delete_volume" :: held 1.095s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Created reservations ['78b602ed-79b5-459e-95ad-123f82656064', '215622e5-9c58-4825-a18e-332483c07dc1', 'b610fa48-59e5-4f55-a0cb-b72eee755b06', '9db8152c-dae7-4173-8a75-92a2b8d9fabf'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:09 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:09 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:10 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:10 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e
Apr 20 23:38:10 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Acquiring lock "cinder-685bff67-1be2-4387-918d-21d00ca9b1f8-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Lock "cinder-685bff67-1be2-4387-918d-21d00ca9b1f8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:10 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Flow 'volume_create_manager' (a2343d16-67df-4f5a-8020-99055d7819f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af74d5e-240c-405f-8414-346d63acf466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Deleted volume successfully.
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af74d5e-240c-405f-8414-346d63acf466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1044085248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd79ea-692a-43a7-8ad5-36e6e684b5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54407f1c9eb4721a94b260071ecad81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:10Z,use_quota=True,user_id='9166d665681d48468c9b11627b48701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b38eec-f68c-44f0-bad8-716c3fdd970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b38eec-f68c-44f0-bad8-716c3fdd970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbaff27-5388-40d6-ad10-8d840434cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbaff27-5388-40d6-ad10-8d840434cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25dd79ea-692a-43a7-8ad5-36e6e684b5ec', 'volume_name': 'volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d36f7d-acac-42bb-9306-ed5ce5854307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d36f7d-acac-42bb-9306-ed5ce5854307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4505e38-baef-4c97-b3d9-cf370978d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Volume 25dd79ea-692a-43a7-8ad5-36e6e684b5ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec', 'volume_size': 1}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1044085248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd79ea-692a-43a7-8ad5-36e6e684b5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54407f1c9eb4721a94b260071ecad81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:10Z,use_quota=True,user_id='9166d665681d48468c9b11627b48701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Creating volume 25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:10 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Acquiring lock "cinder-quobyte-685bff67-1be2-4387-918d-21d00ca9b1f8" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:10 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec 1073741824
Apr 20 23:38:10 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Lock "cinder-quobyte-685bff67-1be2-4387-918d-21d00ca9b1f8" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1bb61d-40f8-4699-ba85-82d5f8699978]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a000a18-dbb3-491b-a0bb-cf94eacde6c3 tempest-SnapshotMetadataTestJSON-1956514516 None] Lock "cinder-e9cc9bb5-5347-4ada-a89d-92d2ec7e9df4-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:10 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8
Apr 20 23:38:10 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:10 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fb8afdd-a60d-49a7-9e55-18ffd671795e" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Lock "cinder-quobyte-4fb8afdd-a60d-49a7-9e55-18ffd671795e" released by "delete_volume" :: held 0.990s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Created reservations ['8142ee29-69e1-4aca-ad4d-e696168dd363'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:10 devstack cinder-volume[82641]: WARNING cinder.quota [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-682066632 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-682066632, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:10 devstack cinder-volume[82641]: WARNING cinder.quota [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-682066632 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-682066632, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Created reservations ['3189ba6c-42bc-4401-9b8f-e3915f78d325', '268f32dd-f2f0-47a8-aa81-e2b7ae0f9df8', '61215c81-2687-4255-95c1-c8883661d6bd', '63b7091f-9149-44f2-8ade-0c92b316cc36'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:10 devstack sudo[86869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:10 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:10 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:10 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8
Apr 20 23:38:10 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:10 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec 1073741824" returned: 0 in 0.553s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:10 devstack sudo[86879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec
Apr 20 23:38:10 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:11 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.539s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-befff27c-c5f5-422c-b59e-e0421c367f57 tempest-GroupsTest-1313173978 None] Delete group completed successfully.
Apr 20 23:38:11 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-685bff67-1be2-4387-918d-21d00ca9b1f8" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Lock "cinder-quobyte-685bff67-1be2-4387-918d-21d00ca9b1f8" released by "delete_volume" :: held 0.953s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:11 devstack cinder-volume[82641]: WARNING cinder.quota [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-51080104 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-51080104, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:11 devstack cinder-volume[82641]: WARNING cinder.quota [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-51080104 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-51080104, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Created reservations ['bffcf2e1-50f2-4519-8af7-86e0dba90738', '550ae358-8bb1-40f2-9a28-cd676d442304', 'ea75fc28-27d6-43ba-9e38-2f94e7bbe4b9', '2dad190f-6e19-43a3-84c7-72289c3db9c7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:11 devstack sudo[86884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:11 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:11 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4505e38-baef-4c97-b3d9-cf370978d304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ef939c-2835-4364-9f3a-97f545e2233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Volume volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec (25dd79ea-692a-43a7-8ad5-36e6e684b5ec): created successfully
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ef939c-2835-4364-9f3a-97f545e2233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Flow 'volume_create_manager' (a2343d16-67df-4f5a-8020-99055d7819f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5c9e1bc0-0180-4be7-9d76-bf5a213493b5 tempest-VolumesDeleteCascade-1287936000 None] Created volume successfully.
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Created reservations ['bc887352-9b87-4850-8059-c8adfc221085'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:11 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:11 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:11 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Deleted volume successfully.
Apr 20 23:38:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23ffcda6-3e73-4823-b7a4-9c7f30afe45c tempest-VolumeTypesAccessTest-956214127 None] Lock "cinder-685bff67-1be2-4387-918d-21d00ca9b1f8-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:12 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-154e3110-0e46-4f93-92ed-2694c14986c6 tempest-GroupsTest-1313173978 None] Delete group completed successfully.
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Flow 'volume_create_manager' (85ee91aa-2533-4e01-ad88-c4fc37684e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc288866-c1c2-42bf-a910-0f31177cb4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc288866-c1c2-42bf-a910-0f31177cb4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-435574578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93862768-28e3-43fb-8619-6c7756db45e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf496cfa722b4d359f1e0986a4553048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:12Z,use_quota=True,user_id='48a4836c93d6409cbf1dc0b503787c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad63380-2940-43eb-9744-32547b897462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad63380-2940-43eb-9744-32547b897462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6afe397-076c-4ef7-9a4c-88a6cfbe4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6afe397-076c-4ef7-9a4c-88a6cfbe4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93862768-28e3-43fb-8619-6c7756db45e2', 'volume_name': 'volume-93862768-28e3-43fb-8619-6c7756db45e2', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d7f6f2-6467-4013-b787-adea2c96c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d7f6f2-6467-4013-b787-adea2c96c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e60b0b-2963-4087-b67f-809aea575e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Volume 93862768-28e3-43fb-8619-6c7756db45e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93862768-28e3-43fb-8619-6c7756db45e2', 'volume_size': 1}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-435574578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93862768-28e3-43fb-8619-6c7756db45e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf496cfa722b4d359f1e0986a4553048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:12Z,use_quota=True,user_id='48a4836c93d6409cbf1dc0b503787c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Creating volume 93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:12 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 1073741824
Apr 20 23:38:12 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:13 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-071353a7-52db-4343-9bc1-5c28ff609d7b tempest-GroupsTest-1313173978 None] Group tempest-GroupsTest-Group-1275809709: creating
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 1073741824" returned: 0 in 0.670s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-071353a7-52db-4343-9bc1-5c28ff609d7b tempest-GroupsTest-1313173978 None] Group tempest-GroupsTest-Group-1275809709: created successfully
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-071353a7-52db-4343-9bc1-5c28ff609d7b tempest-GroupsTest-1313173978 None] Create group completed successfully.
Apr 20 23:38:13 devstack sudo[86897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:13 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:13 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.163s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e60b0b-2963-4087-b67f-809aea575e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93862768-28e3-43fb-8619-6c7756db45e2', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb613b3-2664-4632-9c43-2cf2e8d792e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Creating offline snapshot ad6f022f-ac8a-4358-9e0a-6dddc661c51b of volume 25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:38:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Volume volume-93862768-28e3-43fb-8619-6c7756db45e2 (93862768-28e3-43fb-8619-6c7756db45e2): created successfully
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb613b3-2664-4632-9c43-2cf2e8d792e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Flow 'volume_create_manager' (85ee91aa-2533-4e01-ad88-c4fc37684e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a94a97-6363-406d-b293-eecf4770a8c3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ca5ba6b9-e462-4fd5-96eb-a2bdf6607c1d tempest-VolumesCloneTest-248380027 None] Created volume successfully.
Apr 20 23:38:13 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec
Apr 20 23:38:13 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:14 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" returned: 0 in 0.585s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:14 devstack sudo[86905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b 1G
Apr 20 23:38:14 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Flow 'volume_create_manager' (7173f355-b380-425e-b9c4-c20db8706890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3db9ea-067e-4803-86c9-8eedc173e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3db9ea-067e-4803-86c9-8eedc173e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-60803280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=034c78fd-b527-4d4a-ac7a-c47a15d9346b,host='devstack@QuobyteHD#QuobyteHD',id=d44f8c91-3425-4178-a5a3-0fc1af1d2f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac715aeb49cd4836aeb550759a3a3710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:15Z,use_quota=True,user_id='61d845f8a3e64240932d58b58adddb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b017b720-0e1b-457b-87dd-8864a85c2682),volume_type_id=b017b720-0e1b-457b-87dd-8864a85c2682)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ad197a-d480-49e3-a9f3-8ef0701e3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ad197a-d480-49e3-a9f3-8ef0701e3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1025adc5-2638-4074-b952-622d85f3472e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1025adc5-2638-4074-b952-622d85f3472e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44f8c91-3425-4178-a5a3-0fc1af1d2f23', 'volume_name': 'volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48854a63-43e5-4529-a580-482a1640d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48854a63-43e5-4529-a580-482a1640d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ad7700-6541-46d9-918b-cb2205534d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Volume d44f8c91-3425-4178-a5a3-0fc1af1d2f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23', 'volume_size': 1}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Flow 'volume_create_manager' (3bf92b1a-64f8-4891-b8e9-d63a104b412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120ddf63-5605-4602-9772-fc6240dafe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120ddf63-5605-4602-9772-fc6240dafe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2094417420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8a4e5f-e26e-454d-99ac-71e8ca8a6544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf496cfa722b4d359f1e0986a4553048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=93862768-28e3-43fb-8619-6c7756db45e2,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:15Z,use_quota=True,user_id='48a4836c93d6409cbf1dc0b503787c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d566693-53cd-4ff9-8c5f-6e8807a04a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d566693-53cd-4ff9-8c5f-6e8807a04a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ea2420-8a45-4070-b2d2-8c876a78cc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ea2420-8a45-4070-b2d2-8c876a78cc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1b8a4e5f-e26e-454d-99ac-71e8ca8a6544', 'volume_name': 'volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544', 'volume_size': 2, 'source_volid': '93862768-28e3-43fb-8619-6c7756db45e2', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a47ef1-55e8-44f2-872e-d5d5aa16a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a47ef1-55e8-44f2-872e-d5d5aa16a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef80196-b5c6-463c-86dc-b01b57dbfc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Volume 1b8a4e5f-e26e-454d-99ac-71e8ca8a6544: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544', 'volume_size': 2, 'source_volid': '93862768-28e3-43fb-8619-6c7756db45e2', 'source_volstatus': 'available'}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:15 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b 1G" returned: 0 in 0.680s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:15 devstack sudo[86910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:15 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:15 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:15 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b is being set with open permissions: ugo+rw
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:15 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:15 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:15 devstack sudo[86917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:15 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:16 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:16 devstack sudo[86920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info
Apr 20 23:38:16 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:16 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:16 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:16 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info is being set with open permissions: ugo+rw
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:16 devstack sudo[86924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info
Apr 20 23:38:16 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:16 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.info" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=034c78fd-b527-4d4a-ac7a-c47a15d9346b,created_at=2026-04-20T21:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-60803280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=034c78fd-b527-4d4a-ac7a-c47a15d9346b,host='devstack@QuobyteHD#QuobyteHD',id=d44f8c91-3425-4178-a5a3-0fc1af1d2f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac715aeb49cd4836aeb550759a3a3710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:15Z,use_quota=True,user_id='61d845f8a3e64240932d58b58adddb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b017b720-0e1b-457b-87dd-8864a85c2682),volume_type_id=b017b720-0e1b-457b-87dd-8864a85c2682)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Creating volume d44f8c91-3425-4178-a5a3-0fc1af1d2f23 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:16 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:17 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 1073741824
Apr 20 23:38:17 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-217d6c4c-85bf-4955-81b5-86507925522c tempest-VolumesDeleteCascade-1287936000 None] Create snapshot completed successfully
Apr 20 23:38:17 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 1073741824" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:17 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23
Apr 20 23:38:17 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:17 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.943s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:17 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Cloning volume 93862768-28e3-43fb-8619-6c7756db45e2 to volume 1b8a4e5f-e26e-454d-99ac-71e8ca8a6544
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ad7700-6541-46d9-918b-cb2205534d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474c3d20-52c3-4a33-bc4f-e0d7928024a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Creating offline snapshot 1213e170-4d61-4344-84c6-28cf63f86067 of volume 93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:38:18 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Volume volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 (d44f8c91-3425-4178-a5a3-0fc1af1d2f23): created successfully
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474c3d20-52c3-4a33-bc4f-e0d7928024a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Flow 'volume_create_manager' (7173f355-b380-425e-b9c4-c20db8706890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[19abb7bf-b827-456f-a162-e81c3fd86d9e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-276a61e7-d6e0-4ae4-a5b1-f187040e617b tempest-GroupsTest-1313173978 None] Created volume successfully.
Apr 20 23:38:18 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:18 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:18 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:18 devstack sudo[86947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 1G
Apr 20 23:38:18 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:19 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 1G" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93862768-28e3-43fb-8619-6c7756db45e2 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:19 devstack sudo[86952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93862768-28e3-43fb-8619-6c7756db45e2 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067
Apr 20 23:38:19 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Flow 'volume_create_manager' (9a6901d0-2708-4007-9635-c38e7dda608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00282154-af08-46f4-8674-8fc49b0136ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00282154-af08-46f4-8674-8fc49b0136ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390642958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=034c78fd-b527-4d4a-ac7a-c47a15d9346b,host='devstack@QuobyteHD#QuobyteHD',id=d2a173b3-a9aa-4004-ba9b-62c2934d378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac715aeb49cd4836aeb550759a3a3710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:19Z,use_quota=True,user_id='61d845f8a3e64240932d58b58adddb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b017b720-0e1b-457b-87dd-8864a85c2682),volume_type_id=b017b720-0e1b-457b-87dd-8864a85c2682)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ab1634-599b-4cdb-9765-03a47dd54797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ab1634-599b-4cdb-9765-03a47dd54797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5868a79b-aecc-452d-bf7a-51c15f0cf186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5868a79b-aecc-452d-bf7a-51c15f0cf186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a173b3-a9aa-4004-ba9b-62c2934d378b', 'volume_name': 'volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef0b00f-123f-4c53-bbd0-1c0b82411842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef0b00f-123f-4c53-bbd0-1c0b82411842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95d53f-9cd1-4c54-a1c7-d6e90c8c1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:19 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Volume d2a173b3-a9aa-4004-ba9b-62c2934d378b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b', 'volume_size': 1}
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:19 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93862768-28e3-43fb-8619-6c7756db45e2 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:19 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 is being set with open permissions: ugo+rw
Apr 20 23:38:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:19 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067
Apr 20 23:38:19 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:20 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:20 devstack sudo[86961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info
Apr 20 23:38:20 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:20 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:20 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info is being set with open permissions: ugo+rw
Apr 20 23:38:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:20 devstack sudo[86964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info
Apr 20 23:38:20 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:21 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.info" returned: 0 in 0.437s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Acquiring lock "cinder-quobyte-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] snapshot: 1213e170-4d61-4344-84c6-28cf63f86067, volume: 1b8a4e5f-e26e-454d-99ac-71e8ca8a6544,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e177761-a777-4781-9168-1666c096f8c0]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:21 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067
Apr 20 23:38:21 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:21 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93862768-28e3-43fb-8619-6c7756db45e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c58a8a0-cc95-42a6-ace7-52f3bf12b100]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:21 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:21 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:22 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:22 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:38:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:22 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544
Apr 20 23:38:22 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:24 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" returned: 0 in 2.259s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:24 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d26b8-67f7-4049-bf51-3af00f58617e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:24 devstack sudo[87023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:24 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:25 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.633s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:38:25 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Converted 1024.00 MB image at 453.14 MB/s
Apr 20 23:38:25 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 is being set with open permissions: ugo+rw
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:25 devstack sudo[87028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544
Apr 20 23:38:25 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:25 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" released by "_copy_volume_from_snapshot" :: held 4.457s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=186,cinder:UPDATE=233,cinder:INSERT=50,cinder:DELETE=12 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Acquiring lock "cinder-quobyte-1213e170-4d61-4344-84c6-28cf63f86067" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-1213e170-4d61-4344-84c6-28cf63f86067" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Deleting offline snapshot 1213e170-4d61-4344-84c6-28cf63f86067 of volume 93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] snapshot_file for this snap is: volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[65206a9e-b04f-432a-aa49-e0d4786c1e4b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:25 devstack sudo[87031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067
Apr 20 23:38:25 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:26 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067" returned: 0 in 0.572s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93862768-28e3-43fb-8619-6c7756db45e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d6cd58-47a0-43e0-88c4-c02c57ddc34b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:26 devstack sudo[87036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:26 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:26 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:26 devstack sudo[87041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067
Apr 20 23:38:26 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:27 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:27 devstack sudo[87046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067
Apr 20 23:38:27 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:27 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2.1213e170-4d61-4344-84c6-28cf63f86067" returned: 0 in 0.417s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-1213e170-4d61-4344-84c6-28cf63f86067" released by "_delete_snapshot" :: held 2.085s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=210,cinder:SELECT=208,cinder:INSERT=55,cinder:DELETE=13 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.692s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.966s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef80196-b5c6-463c-86dc-b01b57dbfc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544', 'volume_size': 2, 'source_volid': '93862768-28e3-43fb-8619-6c7756db45e2', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4703d4cb-8a8f-41f4-a349-a5b8a930b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Creating offline snapshot 94b594f8-40d6-40be-ada8-a7770c483c57 of volume 25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:38:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Volume volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 (1b8a4e5f-e26e-454d-99ac-71e8ca8a6544): created successfully
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4703d4cb-8a8f-41f4-a349-a5b8a930b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Flow 'volume_create_manager' (3bf92b1a-64f8-4891-b8e9-d63a104b412a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef5e183-a7a3-42d5-891b-311e253edd3f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3786f5d1-f329-4732-b48e-75d336236ec0 tempest-VolumesCloneTest-248380027 None] Created volume successfully.
Apr 20 23:38:27 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:27 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:28 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:28 devstack sudo[87055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 1G
Apr 20 23:38:28 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:28 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 1G" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:28 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57
Apr 20 23:38:28 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Acquiring lock "cinder-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Lock "cinder-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Acquiring lock "cinder-quobyte-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86f2284-99b1-41cd-8675-2c88c4816bc8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:29 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544
Apr 20 23:38:29 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:29 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57" returned: 0 in 0.576s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:29 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 is being set with open permissions: ugo+rw
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:29 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57
Apr 20 23:38:29 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:29 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" returned: 0 in 0.656s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:29 devstack sudo[87073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544
Apr 20 23:38:29 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:29 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.524s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=034c78fd-b527-4d4a-ac7a-c47a15d9346b,created_at=2026-04-20T21:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-390642958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=034c78fd-b527-4d4a-ac7a-c47a15d9346b,host='devstack@QuobyteHD#QuobyteHD',id=d2a173b3-a9aa-4004-ba9b-62c2934d378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac715aeb49cd4836aeb550759a3a3710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:19Z,use_quota=True,user_id='61d845f8a3e64240932d58b58adddb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b017b720-0e1b-457b-87dd-8864a85c2682),volume_type_id=b017b720-0e1b-457b-87dd-8864a85c2682)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Creating volume d2a173b3-a9aa-4004-ba9b-62c2934d378b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:29 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:29 devstack sudo[87076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b 1073741824
Apr 20 23:38:29 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-76ffe465-975e-49d2-bb6e-4ac5ef93bf7d tempest-VolumesDeleteCascade-1287936000 None] Create snapshot completed successfully
Apr 20 23:38:30 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544" released by "delete_volume" :: held 1.142s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-25dd79ea-692a-43a7-8ad5-36e6e684b5ec-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-25dd79ea-692a-43a7-8ad5-36e6e684b5ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Performing cascade delete. {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-94b594f8-40d6-40be-ada8-a7770c483c57-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Created reservations ['d6dfa365-62d8-4396-bf7e-cb3f7384a864', '5667ae79-d0e8-4434-890c-300a69311363', 'a3f0f381-62bc-4e8d-a655-933162a541df', '57283e87-49a7-49f7-8010-9503ed0f9f6d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-94b594f8-40d6-40be-ada8-a7770c483c57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-94b594f8-40d6-40be-ada8-a7770c483c57" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-94b594f8-40d6-40be-ada8-a7770c483c57" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Deleting offline snapshot 94b594f8-40d6-40be-ada8-a7770c483c57 of volume 25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] snapshot_file for this snap is: volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561110c-96d1-4bbd-b724-00c6973682f1]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:30 devstack sudo[87083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:30 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:30 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57
Apr 20 23:38:30 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:30 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b 1073741824" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:30 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b
Apr 20 23:38:30 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:30 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Deleted volume successfully.
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-317e8bb6-893f-477e-bc1e-bb279aefcd5a tempest-VolumesCloneTest-248380027 None] Lock "cinder-1b8a4e5f-e26e-454d-99ac-71e8ca8a6544-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:30 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b11768-a926-4406-9009-78e10a817e1e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:30 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:30 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:30 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e95d53f-9cd1-4c54-a1c7-d6e90c8c1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ac8405-f961-4590-86ec-bdfeff6be877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:31 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Volume volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b (d2a173b3-a9aa-4004-ba9b-62c2934d378b): created successfully
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ac8405-f961-4590-86ec-bdfeff6be877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Flow 'volume_create_manager' (9a6901d0-2708-4007-9635-c38e7dda608a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-07940c7a-d376-484a-b0ba-c9e1fef011f5 tempest-GroupsTest-1313173978 None] Created volume successfully.
Apr 20 23:38:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-21f4837e-19f1-4a1c-b110-1fe11a07c27c tempest-GroupsTest-1313173978 None] Update group completed successfully.
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Acquiring lock "cinder-93862768-28e3-43fb-8619-6c7756db45e2-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Lock "cinder-93862768-28e3-43fb-8619-6c7756db45e2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Acquiring lock "cinder-quobyte-93862768-28e3-43fb-8619-6c7756db45e2" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-93862768-28e3-43fb-8619-6c7756db45e2" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed964de-26d1-4288-8a12-c984825b0592]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:31 devstack sudo[87099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:31 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:31 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.583s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:31 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57
Apr 20 23:38:31 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:31 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:31 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2
Apr 20 23:38:31 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:31 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:31 devstack sudo[87114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57
Apr 20 23:38:31 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:32 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-93862768-28e3-43fb-8619-6c7756db45e2" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Lock "cinder-quobyte-93862768-28e3-43fb-8619-6c7756db45e2" released by "delete_volume" :: held 0.961s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Created reservations ['0ecddccc-362f-454b-a96e-62027ac41425', '2002eee7-7831-4821-995c-47d2346ef3b9', '61d5263f-92cf-4799-ab7c-c9677b98ea92', 'f1ba7799-a47d-4d78-9af5-2b8f3b1f16e7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:32 devstack sudo[87118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:32 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:32 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.94b594f8-40d6-40be-ada8-a7770c483c57" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-94b594f8-40d6-40be-ada8-a7770c483c57" released by "_delete_snapshot" :: held 2.188s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" released by "delete_snapshot" :: held 2.206s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e13c7012-a199-47ff-a59a-dff0a2298cd2 tempest-GroupsTest-1313173978 None] Update group completed successfully.
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Created reservations ['42306db5-9a23-4a98-ba60-4f1cf2eb3d23', 'b62be01d-7851-4c63-9919-ae001ff496c3', 'fa187f5f-cd2f-4cd2-be0b-d71b119e42a6', '58f2fbbb-e271-4c57-b20f-82bcbeebabce'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Delete snapshot completed successfully.
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-94b594f8-40d6-40be-ada8-a7770c483c57-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-ad6f022f-ac8a-4358-9e0a-6dddc661c51b-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-ad6f022f-ac8a-4358-9e0a-6dddc661c51b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-ad6f022f-ac8a-4358-9e0a-6dddc661c51b" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-ad6f022f-ac8a-4358-9e0a-6dddc661c51b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Deleting offline snapshot ad6f022f-ac8a-4358-9e0a-6dddc661c51b of volume 25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] snapshot_file for this snap is: volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ff967-b5a5-4aa3-b333-822917138e6a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:32 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:32 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:32 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Deleted volume successfully.
Apr 20 23:38:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897ada68-6258-458f-942b-498c602163ff tempest-VolumesCloneTest-248380027 None] Lock "cinder-93862768-28e3-43fb-8619-6c7756db45e2-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:33 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.515s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a4f710-9811-4326-9854-ea3dc9761c3b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:33 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec
Apr 20 23:38:33 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:33 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" returned: 0 in 0.609s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Acquiring lock "cinder-quobyte-d2a173b3-a9aa-4004-ba9b-62c2934d378b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Lock "cinder-quobyte-d2a173b3-a9aa-4004-ba9b-62c2934d378b" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c774f6ec-f826-4ab1-bf1c-d983853e9604]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:33 devstack sudo[87131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:33 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:33 devstack sudo[87132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b
Apr 20 23:38:33 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Flow 'volume_create_manager' (b43b4fb9-80cf-4be1-a31c-e015366f3570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ff18aa-bb0c-4b65-9b9f-8b7be49786df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:34 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.556s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:34 devstack sudo[87141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ff18aa-bb0c-4b65-9b9f-8b7be49786df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-742586751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb914d21-b7b1-4bc1-af7a-e1cec1728c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6626dcd09b6f427c8f4905cc6cf74e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:34Z,use_quota=True,user_id='52ae8d68253e4ec28ebd8c0862e4816a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:34 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c229989-43cc-44a9-9fea-e74013d7cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c229989-43cc-44a9-9fea-e74013d7cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e54032-6f9b-4644-b52f-5990a0c50551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.image.glance [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 23:38:34 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b" returned: 0 in 0.612s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:34 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b
Apr 20 23:38:34 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e54032-6f9b-4644-b52f-5990a0c50551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb914d21-b7b1-4bc1-af7a-e1cec1728c2d', 'volume_name': 'volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93456fb1f0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04404c3-95e8-473e-8000-c074ecfaa2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04404c3-95e8-473e-8000-c074ecfaa2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89433d3-f490-4178-a3a7-cc49f5244c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Volume fb914d21-b7b1-4bc1-af7a-e1cec1728c2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93456fb1f0>}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Trying to clone fb914d21-b7b1-4bc1-af7a-e1cec1728c2d from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 23:38:34 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[906f4a1a-b205-4739-a07a-8248386b2d30]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:34 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec.ad6f022f-ac8a-4358-9e0a-6dddc661c51b" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-ad6f022f-ac8a-4358-9e0a-6dddc661c51b" released by "_delete_snapshot" :: held 2.170s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" released by "delete_snapshot" :: held 2.183s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:34 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD
Apr 20 23:38:34 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Created reservations ['3b46d768-4312-4fcd-92fe-c40b54affb5b', 'acd26a03-c0e0-41bd-bd00-a8e3d8a4101b', '2c8346f6-cb21-4664-9552-8e1abfc734b9', 'e06d3685-b0b8-498f-a675-0d69e2929fe3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Delete snapshot completed successfully.
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-ad6f022f-ac8a-4358-9e0a-6dddc661c51b-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Snapshots deleted, issuing volume delete {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:34 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d2a173b3-a9aa-4004-ba9b-62c2934d378b" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dccb2cb-1537-40db-a16c-e1e816494b60]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Lock "cinder-quobyte-d2a173b3-a9aa-4004-ba9b-62c2934d378b" released by "delete_volume" :: held 1.167s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Acquiring lock "cinder-quobyte-d44f8c91-3425-4178-a5a3-0fc1af1d2f23" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Lock "cinder-quobyte-d44f8c91-3425-4178-a5a3-0fc1af1d2f23" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[031712f6-dc17-42c7-a128-3ac0f04c63b6]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:35 devstack sudo[87150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec
Apr 20 23:38:35 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:35 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23
Apr 20 23:38:35 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:35 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 is fetched for user 52ae8d68253e4ec28ebd8c0862e4816a. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1dbe5-b60c-4af3-a84c-40982ee77e0e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:35 devstack sudo[87160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD
Apr 20 23:38:35 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:35 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" returned: 0 in 0.631s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:35 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec
Apr 20 23:38:35 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:35 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23" returned: 0 in 0.705s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:35 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23
Apr 20 23:38:35 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:36 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-742586751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb914d21-b7b1-4bc1-af7a-e1cec1728c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6626dcd09b6f427c8f4905cc6cf74e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:34Z,use_quota=True,user_id='52ae8d68253e4ec28ebd8c0862e4816a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Creating volume fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:36 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:36 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:36 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 1073741824
Apr 20 23:38:36 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-25dd79ea-692a-43a7-8ad5-36e6e684b5ec" released by "delete_volume" :: held 1.191s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Created reservations ['e1e94108-b5e5-4b5f-a03e-84cc8720466b', '24657bae-c098-402f-a66f-7451800f7bc4', '84c13e9f-dcda-4177-9623-bd8629cb557d', '6f810900-cf8a-43c5-afb9-a17a73a87acb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:36 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:36 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:36 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d44f8c91-3425-4178-a5a3-0fc1af1d2f23" returned: 0 in 0.584s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Lock "cinder-quobyte-d44f8c91-3425-4178-a5a3-0fc1af1d2f23" released by "delete_volume" :: held 1.321s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Created reservations ['a59a798f-2cd2-415e-a677-1aa71955a849'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:36 devstack cinder-volume[82641]: WARNING cinder.quota [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1680418813 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1680418813, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:36 devstack cinder-volume[82641]: WARNING cinder.quota [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1680418813 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1680418813, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Created reservations ['c3a8c290-acdd-4dcd-81ca-65dcde707483', '65806d17-c935-445b-bab3-c5960ec86c47', 'c1f21dc6-31f4-4d34-b7c0-144f00b95fe5', '720d86ac-7995-4723-ba3b-1c093e72bfde'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Created reservations ['2cd984c7-ffa5-4425-bdb5-2b4af357f5c2', 'f11108c9-ed3c-4741-840f-432daf8a0e8f', 'ff71b7ff-6104-4511-a673-cff1897dbc4b', '6b48085a-8420-41dd-a901-9c84c159e39f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:36 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:36 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:36 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 1073741824" returned: 0 in 0.655s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:36 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:36 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:36 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Deleted volume successfully.
Apr 20 23:38:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5420b68e-e483-4e19-9ea1-57e92d9d616b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-25dd79ea-692a-43a7-8ad5-36e6e684b5ec-delete_volume" released by "delete_volume" :: held 6.675s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Flow 'volume_create_manager' (afdd407b-e86a-41eb-a245-0a8777cf18f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7156f50-97e0-4370-8539-c483bc3753a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7156f50-97e0-4370-8539-c483bc3753a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1349437468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760bc8ff-dfff-4698-b387-07bde06d630e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54407f1c9eb4721a94b260071ecad81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:37Z,use_quota=True,user_id='9166d665681d48468c9b11627b48701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8993a958-46e3-4d89-8979-ab1cc216403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8993a958-46e3-4d89-8979-ab1cc216403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:37 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeedb556-f887-4a24-90c5-9666f048e600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeedb556-f887-4a24-90c5-9666f048e600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760bc8ff-dfff-4698-b387-07bde06d630e', 'volume_name': 'volume-760bc8ff-dfff-4698-b387-07bde06d630e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138cd71d-e589-4bea-8662-8816b059d277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138cd71d-e589-4bea-8662-8816b059d277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023a70f3-da66-41d7-bd38-dc255c43142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Volume 760bc8ff-dfff-4698-b387-07bde06d630e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760bc8ff-dfff-4698-b387-07bde06d630e', 'volume_size': 1}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-edac83fc-712b-4d51-b970-b4bd966c06b3 tempest-GroupsTest-1313173978 None] Delete group completed successfully.
Apr 20 23:38:37 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 0 in 0.618s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1349437468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760bc8ff-dfff-4698-b387-07bde06d630e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54407f1c9eb4721a94b260071ecad81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:37Z,use_quota=True,user_id='9166d665681d48468c9b11627b48701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Creating volume 760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:37 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Attempting download of 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume fb914d21-b7b1-4bc1-af7a-e1cec1728c2d. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 23:38:37 devstack sudo[87202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e 1073741824
Apr 20 23:38:37 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ccae9-f382-485e-8ff4-b39edf1904cb]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_ {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:37 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_
Apr 20 23:38:37 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:38 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e 1073741824" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:38 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_ {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:38 devstack sudo[87214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:38 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:38 devstack sudo[87215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_
Apr 20 23:38:38 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:38 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_" returned: 1 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_8pl09ew_' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e273ee9d-9ce4-428e-825e-675bd5baa2e5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:38 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023a70f3-da66-41d7-bd38-dc255c43142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760bc8ff-dfff-4698-b387-07bde06d630e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb571b79-dfa1-4290-8119-08273884854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Volume volume-760bc8ff-dfff-4698-b387-07bde06d630e (760bc8ff-dfff-4698-b387-07bde06d630e): created successfully
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb571b79-dfa1-4290-8119-08273884854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Flow 'volume_create_manager' (afdd407b-e86a-41eb-a245-0a8777cf18f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-036187b9-63e2-4e5c-a4cb-9ae29d624baa tempest-VolumesDeleteCascade-1287936000 None] Created volume successfully.
Apr 20 23:38:38 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD
Apr 20 23:38:38 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:39 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:39 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:39 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Creating offline snapshot 03f94c25-d084-44a3-9e70-be34e9ffbaa3 of volume 760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce7a089-baf5-427b-b47d-60ecd043b615]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:39 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:39 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:39 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.623s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:39 devstack sudo[87250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 1G
Apr 20 23:38:39 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:39 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 0 in 0.933s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_265dce6mdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:38:40 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:40 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 1G
Apr 20 23:38:40 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:40 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 1G" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760bc8ff-dfff-4698-b387-07bde06d630e -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:40 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760bc8ff-dfff-4698-b387-07bde06d630e -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3
Apr 20 23:38:40 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fd9d9984-aa09-474b-884a-70a8e275ff82 tempest-GroupsV314Test-2078578187 None] Group tempest-GroupsV314Test-Group-1903541726: creating
Apr 20 23:38:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fd9d9984-aa09-474b-884a-70a8e275ff82 tempest-GroupsV314Test-2078578187 None] Group tempest-GroupsV314Test-Group-1903541726: created successfully
Apr 20 23:38:40 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 1G" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fd9d9984-aa09-474b-884a-70a8e275ff82 tempest-GroupsV314Test-2078578187 None] Create group completed successfully.
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd66c8-fe1a-4c0d-b7ee-5090c1f83df0]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:40 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:40 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:40 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760bc8ff-dfff-4698-b387-07bde06d630e -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3" returned: 0 in 0.430s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:40 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 is being set with open permissions: ugo+rw
Apr 20 23:38:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:40 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3
Apr 20 23:38:40 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:41 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:41 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:41 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:41 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:41 devstack sudo[87276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info
Apr 20 23:38:41 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:41 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 1 in 0.873s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:38:41 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Downloaded image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume fb914d21-b7b1-4bc1-af7a-e1cec1728c2d successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 for user 52ae8d68253e4ec28ebd8c0862e4816a is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Marking volume fb914d21-b7b1-4bc1-af7a-e1cec1728c2d as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Copying metadata from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 to fb914d21-b7b1-4bc1-af7a-e1cec1728c2d. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Creating volume glance metadata for volume fb914d21-b7b1-4bc1-af7a-e1cec1728c2d backed by image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89433d3-f490-4178-a3a7-cc49f5244c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93456fb1f0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34d9580-43d4-4aa2-9233-df1379a079c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Volume volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d (fb914d21-b7b1-4bc1-af7a-e1cec1728c2d): created successfully
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34d9580-43d4-4aa2-9233-df1379a079c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Flow 'volume_create_manager' (b43b4fb9-80cf-4be1-a31c-e015366f3570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e641b6fe-dceb-4c7b-a71d-0269f58dd463 tempest-VolumesExtendTest-340455827 None] Created volume successfully.
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Flow 'volume_create_manager' (5551aee3-ba82-4dab-a5ae-7e30fedf2631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064fad82-4004-49c5-a4cb-b01bc0d23d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064fad82-4004-49c5-a4cb-b01bc0d23d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389582075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe7ed8f8-5026-47ed-a39a-fb6e3646b1e9,host='devstack@QuobyteHD#QuobyteHD',id=da02b6ce-283b-46d4-9b95-9509ec5c8d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f476bb0a0cf240708f2db8da7022036a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:42Z,use_quota=True,user_id='01683c1b542b42e09a06ccbdacc93cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c66cf47-0412-4755-922d-f51003675a15),volume_type_id=4c66cf47-0412-4755-922d-f51003675a15)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282fb4b-a372-4292-a93f-2ed8805877c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282fb4b-a372-4292-a93f-2ed8805877c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c8d6fb-f1ae-4709-9bf1-2da6a0c04798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c8d6fb-f1ae-4709-9bf1-2da6a0c04798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da02b6ce-283b-46d4-9b95-9509ec5c8d32', 'volume_name': 'volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:42 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac859d6-5764-4567-9e92-284efd9bc341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac859d6-5764-4567-9e92-284efd9bc341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d852c29-a8cd-4c3d-b135-86ecaeafe54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Volume da02b6ce-283b-46d4-9b95-9509ec5c8d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32', 'volume_size': 1}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info" returned: 0 in 0.852s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:42 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info is being set with open permissions: ugo+rw
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:42 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info
Apr 20 23:38:42 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:42 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.info" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.420s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fe7ed8f8-5026-47ed-a39a-fb6e3646b1e9,created_at=2026-04-20T21:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389582075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe7ed8f8-5026-47ed-a39a-fb6e3646b1e9,host='devstack@QuobyteHD#QuobyteHD',id=da02b6ce-283b-46d4-9b95-9509ec5c8d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f476bb0a0cf240708f2db8da7022036a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:42Z,use_quota=True,user_id='01683c1b542b42e09a06ccbdacc93cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c66cf47-0412-4755-922d-f51003675a15),volume_type_id=4c66cf47-0412-4755-922d-f51003675a15)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Creating volume da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:42 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:42 devstack sudo[87311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 1073741824
Apr 20 23:38:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f53e06dd-f5f2-4a3c-8ef3-0050c31cf010 tempest-VolumesDeleteCascade-1287936000 None] Create snapshot completed successfully
Apr 20 23:38:42 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:43 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 1073741824" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:43 devstack sudo[87316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:38:43 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:43 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.849s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d852c29-a8cd-4c3d-b135-86ecaeafe54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56019e12-adde-452b-9ca6-0c040a31e373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Flow 'volume_create_manager' (eddfa2f3-f797-4e22-9e7b-69e716e4a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28e4fd7-16c3-4e3b-9e87-23689bf45b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[26391890-301b-4898-8505-61ac0ef6169c]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28e4fd7-16c3-4e3b-9e87-23689bf45b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1482808256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816e5579-7190-41d0-8aef-a6adb21f31f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54407f1c9eb4721a94b260071ecad81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03f94c25-d084-44a3-9e70-be34e9ffbaa3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:44Z,use_quota=True,user_id='9166d665681d48468c9b11627b48701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20936da-9d1f-49c0-b504-7503688cc65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20936da-9d1f-49c0-b504-7503688cc65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f198a001-6f62-4751-b2b7-3b912d506eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f198a001-6f62-4751-b2b7-3b912d506eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '816e5579-7190-41d0-8aef-a6adb21f31f8', 'volume_name': 'volume-816e5579-7190-41d0-8aef-a6adb21f31f8', 'volume_size': 1, 'snapshot_id': '03f94c25-d084-44a3-9e70-be34e9ffbaa3'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58efce88-3ad2-49e2-b768-caeb525758fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58efce88-3ad2-49e2-b768-caeb525758fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344155f7-518b-49de-9ca8-0256823b47df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Volume 816e5579-7190-41d0-8aef-a6adb21f31f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-816e5579-7190-41d0-8aef-a6adb21f31f8', 'volume_size': 1, 'snapshot_id': '03f94c25-d084-44a3-9e70-be34e9ffbaa3'}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Volume volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 (da02b6ce-283b-46d4-9b95-9509ec5c8d32): created successfully
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56019e12-adde-452b-9ca6-0c040a31e373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Flow 'volume_create_manager' (5551aee3-ba82-4dab-a5ae-7e30fedf2631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5db39f0e-c189-40ac-9ced-816a2f438e6b tempest-GroupsV314Test-2078578187 None] Created volume successfully.
Apr 20 23:38:44 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:44 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (2d94bfef-7d18-46a0-862f-8f0bcaeb1283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26623136-bc30-41a6-baba-c4c503cfad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26623136-bc30-41a6-baba-c4c503cfad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-633677154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40409de-54f6-466d-9d9b-d26bd1827d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:44Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee12b7e-b02a-452e-8b22-4b071ea62fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee12b7e-b02a-452e-8b22-4b071ea62fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e438c8-4429-470a-8999-881e223fb70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e438c8-4429-470a-8999-881e223fb70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40409de-54f6-466d-9d9b-d26bd1827d5c', 'volume_name': 'volume-f40409de-54f6-466d-9d9b-d26bd1827d5c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181bf62e-b6b3-471b-9bf8-14ca0fd50fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181bf62e-b6b3-471b-9bf8-14ca0fd50fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0683c63-fcc9-488d-8f7e-23002254eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Volume f40409de-54f6-466d-9d9b-d26bd1827d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40409de-54f6-466d-9d9b-d26bd1827d5c', 'volume_size': 1}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:44 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:44 devstack sudo[87323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:44 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:45 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 1 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 2G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d 2G" returned: 0 in 0.049s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.200s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.059s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-03f94c25-d084-44a3-9e70-be34e9ffbaa3-816e5579-7190-41d0-8aef-a6adb21f31f8" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-03f94c25-d084-44a3-9e70-be34e9ffbaa3-816e5579-7190-41d0-8aef-a6adb21f31f8" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Creating volume 816e5579-7190-41d0-8aef-a6adb21f31f8 from snapshot 03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-816e5579-7190-41d0-8aef-a6adb21f31f8" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-816e5579-7190-41d0-8aef-a6adb21f31f8" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] snapshot: 03f94c25-d084-44a3-9e70-be34e9ffbaa3, volume: 816e5579-7190-41d0-8aef-a6adb21f31f8,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf17547e-7d74-47ec-a653-20275bdcd1a4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:45 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3
Apr 20 23:38:45 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-56b2ac7f-1c7d-4040-9295-48ded2d761fa tempest-VolumesExtendTest-340455827 None] Extend volume completed successfully.
Apr 20 23:38:45 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760bc8ff-dfff-4698-b387-07bde06d630e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3075f-b595-4d69-869f-5ae756e1801b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:45 devstack sudo[87336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:45 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:46 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:46 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8
Apr 20 23:38:46 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Lock "cinder-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-quobyte-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c2a751-9163-48b2-b9ee-2491167c972d]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:46 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:46 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:47 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 0 in 1.554s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:48 devstack sudo[87359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:48 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:48 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8" returned: 0 in 2.305s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[70556258-6549-4bca-8d64-1ba5736e237c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:48 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:48 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:48 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 1 in 0.736s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:38:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:48 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d
Apr 20 23:38:48 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:49 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.612s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:38:49 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Converted 1024.00 MB image at 444.00 MB/s
Apr 20 23:38:49 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 is being set with open permissions: ugo+rw
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:49 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8
Apr 20 23:38:49 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:49 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d" released by "delete_volume" :: held 2.767s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Created reservations ['cd4d7528-2ad4-4d0d-b363-97ff0ffa7a7d', 'ceca87a4-35e9-477b-8ae5-623d90ad5229', 'c85afaaf-43ea-4404-b99c-5d5eeb8f789c', 'a3da54e3-7b10-4fb2-880d-70e94c024196'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:49 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:49 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:49 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-816e5579-7190-41d0-8aef-a6adb21f31f8" released by "_copy_volume_from_snapshot" :: held 4.363s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-03f94c25-d084-44a3-9e70-be34e9ffbaa3-816e5579-7190-41d0-8aef-a6adb21f31f8" released by "_create_volume_from_snapshot" :: held 4.420s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.446s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.391s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-633677154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40409de-54f6-466d-9d9b-d26bd1827d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:44Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Creating volume f40409de-54f6-466d-9d9b-d26bd1827d5c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:38:49 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:49 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c 1073741824
Apr 20 23:38:49 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344155f7-518b-49de-9ca8-0256823b47df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816e5579-7190-41d0-8aef-a6adb21f31f8', 'volume_size': 1, 'snapshot_id': '03f94c25-d084-44a3-9e70-be34e9ffbaa3'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2939dd81-1791-4f0e-b15d-39240d034fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Volume volume-816e5579-7190-41d0-8aef-a6adb21f31f8 (816e5579-7190-41d0-8aef-a6adb21f31f8): created successfully
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2939dd81-1791-4f0e-b15d-39240d034fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Flow 'volume_create_manager' (eddfa2f3-f797-4e22-9e7b-69e716e4a69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9d20cf8c-c895-4772-b56e-2aebddfd61e9 tempest-VolumesDeleteCascade-1287936000 None] Created volume successfully.
Apr 20 23:38:49 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Deleted volume successfully.
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-872c116e-e111-4573-8277-76f0a583ef02 tempest-VolumesExtendTest-340455827 None] Lock "cinder-fb914d21-b7b1-4bc1-af7a-e1cec1728c2d-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Flow 'volume_create_manager' (e6e584d6-4b79-4bb0-84f4-5a5b9ef85aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bad092-a126-4f7f-bb0c-f7c835b90a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bad092-a126-4f7f-bb0c-f7c835b90a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-119779953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533a72cc-d10c-42bd-becd-dd596c67c199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6626dcd09b6f427c8f4905cc6cf74e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:50Z,use_quota=True,user_id='52ae8d68253e4ec28ebd8c0862e4816a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5273eb8-209c-410b-85a0-b3e973051fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5273eb8-209c-410b-85a0-b3e973051fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05e1290-3954-413b-8684-ba5453386881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05e1290-3954-413b-8684-ba5453386881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533a72cc-d10c-42bd-becd-dd596c67c199', 'volume_name': 'volume-533a72cc-d10c-42bd-becd-dd596c67c199', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a373a4-df59-491e-844e-9fd0e6808da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a373a4-df59-491e-844e-9fd0e6808da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ada9564-0cfe-4367-b336-fb7f6c3edddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Volume 533a72cc-d10c-42bd-becd-dd596c67c199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533a72cc-d10c-42bd-becd-dd596c67c199', 'volume_size': 1}
Apr 20 23:38:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:50 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c 1073741824" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:50 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c
Apr 20 23:38:50 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-760bc8ff-dfff-4698-b387-07bde06d630e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-760bc8ff-dfff-4698-b387-07bde06d630e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Performing cascade delete. {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-03f94c25-d084-44a3-9e70-be34e9ffbaa3-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-03f94c25-d084-44a3-9e70-be34e9ffbaa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-760bc8ff-dfff-4698-b387-07bde06d630e" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-760bc8ff-dfff-4698-b387-07bde06d630e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-03f94c25-d084-44a3-9e70-be34e9ffbaa3" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-03f94c25-d084-44a3-9e70-be34e9ffbaa3" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Deleting offline snapshot 03f94c25-d084-44a3-9e70-be34e9ffbaa3 of volume 760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] snapshot_file for this snap is: volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc34cf25-0438-492a-a9af-7d801c55d210]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:50 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3
Apr 20 23:38:50 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:50 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.383s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:50 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Cloning volume da02b6ce-283b-46d4-9b95-9509ec5c8d32 to volume 3ad03eff-3f85-4337-ab00-16e25e2b72c9
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0683c63-fcc9-488d-8f7e-23002254eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40409de-54f6-466d-9d9b-d26bd1827d5c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce632f19-aace-4779-9b43-75b35e80db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:50 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Volume volume-f40409de-54f6-466d-9d9b-d26bd1827d5c (f40409de-54f6-466d-9d9b-d26bd1827d5c): created successfully
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce632f19-aace-4779-9b43-75b35e80db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (2d94bfef-7d18-46a0-862f-8f0bcaeb1283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Creating offline snapshot 5af51f5a-5db2-483d-ae67-2d877f3406ad of volume da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:38:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cbea3b10-4bfd-411b-8ff6-2aef31e15bfb tempest-VolumesActionsTest-1614412969 None] Created volume successfully.
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d44212-d43a-46ac-8b7c-efe5fbfdc2bd]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:50 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:38:50 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:50 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760bc8ff-dfff-4698-b387-07bde06d630e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0e21b-ce9a-4c65-b9fc-7ae9905a785d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:50 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:50 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:51 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:51 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad 1G
Apr 20 23:38:51 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:51 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:51 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3
Apr 20 23:38:51 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f180e17b-f313-4447-a704-0da62944fcfe tempest-VolumesActionsTest-1614412969 None] Acquiring lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c" by "attach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f180e17b-f313-4447-a704-0da62944fcfe tempest-VolumesActionsTest-1614412969 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c" acquired by "attach_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f180e17b-f313-4447-a704-0da62944fcfe tempest-VolumesActionsTest-1614412969 None] Attaching volume f40409de-54f6-466d-9d9b-d26bd1827d5c to instance 72c270c1-f613-43de-8ef1-0bcb2cdbbe4e at mountpoint /dev/vdb on host None.
Apr 20 23:38:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f180e17b-f313-4447-a704-0da62944fcfe tempest-VolumesActionsTest-1614412969 None] Attach volume completed successfully.
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f180e17b-f313-4447-a704-0da62944fcfe tempest-VolumesActionsTest-1614412969 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c" released by "attach_volume" :: held 0.072s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:51 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad 1G" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:51 devstack sudo[87410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad
Apr 20 23:38:51 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:51 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:52 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3
Apr 20 23:38:52 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:52 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:52 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:52 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad
Apr 20 23:38:52 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:52 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e.03f94c25-d084-44a3-9e70-be34e9ffbaa3" returned: 0 in 0.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-03f94c25-d084-44a3-9e70-be34e9ffbaa3" released by "_delete_snapshot" :: held 2.106s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-760bc8ff-dfff-4698-b387-07bde06d630e" released by "delete_snapshot" :: held 2.117s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Created reservations ['fc048ebf-6fc3-4aa5-b78d-2cffb1dd3851', 'e9d3e370-efaa-4cc7-86ec-1aa35b649b20', '39f9d88e-bbce-47e9-8825-76ed79d2dc06', '446ff72c-657e-4204-ae76-5c3a1dd27f01'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-709889f2-b745-47f6-a532-7544d34fbb05 tempest-VolumesActionsTest-1510962409 None] Terminate volume connection completed successfully.
Apr 20 23:38:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Delete snapshot completed successfully.
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-03f94c25-d084-44a3-9e70-be34e9ffbaa3-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Snapshots deleted, issuing volume delete {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-760bc8ff-dfff-4698-b387-07bde06d630e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-760bc8ff-dfff-4698-b387-07bde06d630e" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7643e-e16d-486b-bf91-70197a3b9648]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:52 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:52 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:52 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:52 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info
Apr 20 23:38:52 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-709889f2-b745-47f6-a532-7544d34fbb05 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-709889f2-b745-47f6-a532-7544d34fbb05 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-709889f2-b745-47f6-a532-7544d34fbb05 tempest-VolumesActionsTest-1510962409 None] Detaching volume f40409de-54f6-466d-9d9b-d26bd1827d5c from instance 72c270c1-f613-43de-8ef1-0bcb2cdbbe4e.
Apr 20 23:38:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-709889f2-b745-47f6-a532-7544d34fbb05 tempest-VolumesActionsTest-1510962409 None] Detach volume completed successfully.
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-709889f2-b745-47f6-a532-7544d34fbb05 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:53 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:53 devstack sudo[87432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e
Apr 20 23:38:53 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:53 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:53 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:53 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info
Apr 20 23:38:53 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:53 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-760bc8ff-dfff-4698-b387-07bde06d630e" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-760bc8ff-dfff-4698-b387-07bde06d630e" released by "delete_volume" :: held 1.041s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:53 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.info" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Acquiring lock "cinder-quobyte-3ad03eff-3f85-4337-ab00-16e25e2b72c9" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-3ad03eff-3f85-4337-ab00-16e25e2b72c9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] snapshot: 5af51f5a-5db2-483d-ae67-2d877f3406ad, volume: 3ad03eff-3f85-4337-ab00-16e25e2b72c9,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7899913-ee3c-4c33-97de-ab0ad87c54d6 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a498055-ef0e-40b1-a560-3cd8e4dcb148]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7899913-ee3c-4c33-97de-ab0ad87c54d6 tempest-VolumesActionsTest-1614412969 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a7899913-ee3c-4c33-97de-ab0ad87c54d6 tempest-VolumesActionsTest-1614412969 None] Volume detach called, but volume not attached.
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7899913-ee3c-4c33-97de-ab0ad87c54d6 tempest-VolumesActionsTest-1614412969 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Created reservations ['4ecabb79-52ee-4d9c-ab90-171d3ce6e6a0', '41883439-be00-49d8-8b01-48073f1236c7', 'bb4ff061-08ab-415a-9549-c50a40527004', '820270ab-392b-47bc-9abd-877dd69abfe6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:53 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad
Apr 20 23:38:53 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:53 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:53 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:54 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51d4b97-1fc8-4be1-843c-91c1ca1bf173]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:54 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Deleted volume successfully.
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-664db025-ce95-4482-9738-21f9a78df193 tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-760bc8ff-dfff-4698-b387-07bde06d630e-delete_volume" released by "delete_volume" :: held 3.981s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:54 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:38:54 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Acquiring lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Acquiring lock "cinder-quobyte-f40409de-54f6-466d-9d9b-d26bd1827d5c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Lock "cinder-quobyte-f40409de-54f6-466d-9d9b-d26bd1827d5c" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddcd820-a2a8-4e97-b5bf-63b9f127f243]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:54 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c
Apr 20 23:38:54 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-816e5579-7190-41d0-8aef-a6adb21f31f8-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-816e5579-7190-41d0-8aef-a6adb21f31f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "cinder-quobyte-816e5579-7190-41d0-8aef-a6adb21f31f8" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-816e5579-7190-41d0-8aef-a6adb21f31f8" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:54 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c2f54-62f6-402b-b533-b1a895011ca8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:54 devstack sudo[87453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9
Apr 20 23:38:54 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:54 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8
Apr 20 23:38:54 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:55 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c" returned: 0 in 0.617s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:55 devstack sudo[87460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c
Apr 20 23:38:55 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:55 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:55 devstack sudo[87474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8
Apr 20 23:38:55 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:56 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f40409de-54f6-466d-9d9b-d26bd1827d5c" returned: 0 in 1.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Lock "cinder-quobyte-f40409de-54f6-466d-9d9b-d26bd1827d5c" released by "delete_volume" :: held 2.123s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:56 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-816e5579-7190-41d0-8aef-a6adb21f31f8" returned: 0 in 1.272s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-quobyte-816e5579-7190-41d0-8aef-a6adb21f31f8" released by "delete_volume" :: held 1.865s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Created reservations ['a14301a3-bbda-4cb2-82c1-74170c488a02', '5b89b387-a527-483b-b2c6-973753decc56', '99dbe483-636e-41d4-8bd9-6c593c19ed27', 'f52f55dc-13cf-40e1-96ed-c71d10c1c5f9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Created reservations ['bacb01e5-43ab-489b-ae78-96f243e29592', '6f1477fc-eba5-4c3f-bb4c-d5441215fe7a', '16e7c214-7065-43e0-9d92-a2847e200140', '26b2a10b-1ee4-4d33-b2bc-5ef6d18466d4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:57 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:57 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:57 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:38:57 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:57 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9" returned: 0 in 2.816s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7444b-912e-4735-987c-cf384fc15f03]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:57 devstack sudo[87483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:38:57 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:57 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.938s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Deleted volume successfully.
Apr 20 23:38:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-751524cd-4233-438e-9866-b06b17c5004c tempest-VolumesActionsTest-1614412969 None] Lock "cinder-f40409de-54f6-466d-9d9b-d26bd1827d5c-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:58 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.854s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:38:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Deleted volume successfully.
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e9559678-fe46-4f65-911c-b2ba84f8a05b tempest-VolumesDeleteCascade-1287936000 None] Lock "cinder-816e5579-7190-41d0-8aef-a6adb21f31f8-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:58 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.848s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32, size 1024.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:38:58 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Converted 1024.00 MB image at 363.43 MB/s
Apr 20 23:38:58 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:58 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9
Apr 20 23:38:58 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:58 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-3ad03eff-3f85-4337-ab00-16e25e2b72c9" released by "_copy_volume_from_snapshot" :: held 5.307s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Acquiring lock "cinder-quobyte-5af51f5a-5db2-483d-ae67-2d877f3406ad" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-5af51f5a-5db2-483d-ae67-2d877f3406ad" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Deleting offline snapshot 5af51f5a-5db2-483d-ae67-2d877f3406ad of volume da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] snapshot_file for this snap is: volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:38:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[da64fbc6-1819-4e87-8bf6-a4ecb3c0cf10]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:59 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad
Apr 20 23:38:59 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:59 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e61480-361b-4d37-a64f-b85dc9d0c035]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:38:59 devstack sudo[87528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:38:59 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Flow 'volume_create_manager' (cea54bbe-b804-45a7-9565-268cae1b4518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9e9c0d-1c21-4631-b203-089d06801395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9e9c0d-1c21-4631-b203-089d06801395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-630349749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978a1a48-80ca-44a0-abac-9cd4bb607776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a76a196634950935ce7c3e47d609e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:00Z,use_quota=True,user_id='c3f630788017420fbea096610b61ea63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53bac09-7e12-45f5-beac-0e0e78b4b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53bac09-7e12-45f5-beac-0e0e78b4b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b170a191-b105-453c-bbfe-f5f295a4fd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b170a191-b105-453c-bbfe-f5f295a4fd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978a1a48-80ca-44a0-abac-9cd4bb607776', 'volume_name': 'volume-978a1a48-80ca-44a0-abac-9cd4bb607776', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a4be82-edca-4d9c-8f2e-c96bac84ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a4be82-edca-4d9c-8f2e-c96bac84ea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e96c54-29be-44ae-a3a9-84c15db1ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:38:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Volume 978a1a48-80ca-44a0-abac-9cd4bb607776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978a1a48-80ca-44a0-abac-9cd4bb607776', 'volume_size': 1}
Apr 20 23:38:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:00 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.532s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:00 devstack sudo[87533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad
Apr 20 23:39:00 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:00 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:00 devstack sudo[87539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad
Apr 20 23:39:00 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:00 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32.5af51f5a-5db2-483d-ae67-2d877f3406ad" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-5af51f5a-5db2-483d-ae67-2d877f3406ad" released by "_delete_snapshot" :: held 2.018s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.376s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.054s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-119779953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533a72cc-d10c-42bd-becd-dd596c67c199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6626dcd09b6f427c8f4905cc6cf74e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:38:50Z,use_quota=True,user_id='52ae8d68253e4ec28ebd8c0862e4816a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Creating volume 533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:01 devstack sudo[87543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 1073741824
Apr 20 23:39:01 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9f35e0ed-e4a9-4d72-bf3c-0344bd302e7f tempest-GroupsV314Test-2078578187 None] Create group from source-group-fe7ed8f8-5026-47ed-a39a-fb6e3646b1e9 completed successfully.
Apr 20 23:39:01 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 1073741824" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:01 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199
Apr 20 23:39:01 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:01 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-630349749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978a1a48-80ca-44a0-abac-9cd4bb607776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a76a196634950935ce7c3e47d609e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:00Z,use_quota=True,user_id='c3f630788017420fbea096610b61ea63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Creating volume 978a1a48-80ca-44a0-abac-9cd4bb607776 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:02 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:02 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776 1073741824
Apr 20 23:39:02 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ada9564-0cfe-4367-b336-fb7f6c3edddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533a72cc-d10c-42bd-becd-dd596c67c199', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1ecca6-2363-4157-b199-4721808b0a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Volume volume-533a72cc-d10c-42bd-becd-dd596c67c199 (533a72cc-d10c-42bd-becd-dd596c67c199): created successfully
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1ecca6-2363-4157-b199-4721808b0a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Flow 'volume_create_manager' (e6e584d6-4b79-4bb0-84f4-5a5b9ef85aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-17686869-28ee-48d7-a4de-fc93815c1605 tempest-VolumesExtendTest-340455827 None] Created volume successfully.
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Acquiring lock "cinder-quobyte-3ad03eff-3f85-4337-ab00-16e25e2b72c9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-3ad03eff-3f85-4337-ab00-16e25e2b72c9" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a4c5cf-4811-49aa-acca-f6b1223c264a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:02 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9
Apr 20 23:39:02 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:02 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776 1073741824" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:02 devstack sudo[87561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776
Apr 20 23:39:02 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:02 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:02 devstack sudo[87563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9
Apr 20 23:39:02 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:03 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.054s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e96c54-29be-44ae-a3a9-84c15db1ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978a1a48-80ca-44a0-abac-9cd4bb607776', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037c158e-59a9-467d-804f-3a3fa0c729ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Creating offline snapshot 2592b240-15c2-402c-abe4-9ad4e272b380 of volume 533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Volume volume-978a1a48-80ca-44a0-abac-9cd4bb607776 (978a1a48-80ca-44a0-abac-9cd4bb607776): created successfully
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037c158e-59a9-467d-804f-3a3fa0c729ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Flow 'volume_create_manager' (cea54bbe-b804-45a7-9565-268cae1b4518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eae69d-7eef-47d3-b951-cb574c6cc1af]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7484eb64-b7d4-4025-bebf-3cb9d9ac96a5 tempest-VolumesMetadataTest-1960390845 None] Created volume successfully.
Apr 20 23:39:03 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3ad03eff-3f85-4337-ab00-16e25e2b72c9" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-3ad03eff-3f85-4337-ab00-16e25e2b72c9" released by "delete_volume" :: held 1.021s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Created reservations ['806ebf3e-deb2-40dd-b559-36dfc7954ca2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:03 devstack cinder-volume[82641]: WARNING cinder.quota [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1870914407 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1870914407, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:39:03 devstack cinder-volume[82641]: WARNING cinder.quota [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1870914407 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1870914407, it is now deprecated. Please use the default quota class for default quota.
Apr 20 23:39:03 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199
Apr 20 23:39:03 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Created reservations ['6f1f44b1-573e-4450-ba36-56c2c38b6565', '6fc29c26-c153-4193-a5ae-916130b757d6', 'a4e7e7c5-8f71-4e6c-be17-9a6446b6be5c', '1b07b1ac-be5d-439d-ac7a-724ce99ed3dd'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:03 devstack sudo[87569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:03 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:03 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199" returned: 0 in 0.507s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:03 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 1G
Apr 20 23:39:03 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:03 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:03 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6d9ee677-8e1d-431d-a748-719f03853d7b tempest-GroupsV314Test-2078578187 None] Delete group completed successfully.
Apr 20 23:39:04 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 1G" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533a72cc-d10c-42bd-becd-dd596c67c199 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:04 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533a72cc-d10c-42bd-becd-dd596c67c199 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380
Apr 20 23:39:04 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (0fd08e28-a05c-4089-93d9-a167b8592835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08758967-1c27-4fb9-adc9-26c6d46d8423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08758967-1c27-4fb9-adc9-26c6d46d8423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1522475045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306c90bb-0a98-4d79-837e-094c658f14b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:04Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb167a2-0061-499b-a650-e4eb32efc38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb167a2-0061-499b-a650-e4eb32efc38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf27155-e8a7-45c1-ba1e-1c70b439ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf27155-e8a7-45c1-ba1e-1c70b439ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306c90bb-0a98-4d79-837e-094c658f14b9', 'volume_name': 'volume-306c90bb-0a98-4d79-837e-094c658f14b9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41852c12-c28f-42e9-8a11-aecb82c10d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41852c12-c28f-42e9-8a11-aecb82c10d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4ab535-7ae3-4fa3-8552-cd813d20c072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:04 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Volume 306c90bb-0a98-4d79-837e-094c658f14b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306c90bb-0a98-4d79-837e-094c658f14b9', 'volume_size': 1}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Acquiring lock "cinder-quobyte-da02b6ce-283b-46d4-9b95-9509ec5c8d32" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-da02b6ce-283b-46d4-9b95-9509ec5c8d32" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3e3f5-f6a9-40f0-89ab-dd13b47eba20]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:04 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:39:04 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:04 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533a72cc-d10c-42bd-becd-dd596c67c199 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:04 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 is being set with open permissions: ugo+rw
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:04 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380
Apr 20 23:39:04 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Acquiring lock "cinder-978a1a48-80ca-44a0-abac-9cd4bb607776-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Lock "cinder-978a1a48-80ca-44a0-abac-9cd4bb607776-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Acquiring lock "cinder-quobyte-978a1a48-80ca-44a0-abac-9cd4bb607776" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Lock "cinder-quobyte-978a1a48-80ca-44a0-abac-9cd4bb607776" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[76840e02-398e-4a8f-aa00-5ca59c67cb69]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:04 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776
Apr 20 23:39:04 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:05 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:05 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32
Apr 20 23:39:05 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:05 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:05 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info
Apr 20 23:39:05 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:05 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:05 devstack sudo[87602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776
Apr 20 23:39:05 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:05 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-da02b6ce-283b-46d4-9b95-9509ec5c8d32" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Lock "cinder-quobyte-da02b6ce-283b-46d4-9b95-9509ec5c8d32" released by "delete_volume" :: held 1.031s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Created reservations ['4a6b4373-07d6-4276-951b-0a08140abc06'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Created reservations ['72783785-d427-4b2e-bb87-4f82c30f95cc', '1b9031a6-4aab-4442-8a61-658f1d296b92', 'b36274b8-ef16-47cb-99ef-67ec03f5d9c6', 'c384939d-5cc2-45f4-9b70-15e304329336'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:05 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:05 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info is being set with open permissions: ugo+rw
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:05 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info
Apr 20 23:39:05 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:05 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:05 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:05 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-978a1a48-80ca-44a0-abac-9cd4bb607776" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Lock "cinder-quobyte-978a1a48-80ca-44a0-abac-9cd4bb607776" released by "delete_volume" :: held 0.932s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Created reservations ['a959fac3-3f69-41dc-a697-55a28b4101e5', '8b8947c1-b53b-4545-9d31-924c89a09949', '67d230d8-f714-4a87-b012-19fd3197c49d', 'ef93a0d5-5e4c-4807-a8a4-f282f7f48b4f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:05 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:05 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:06 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.info" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:06 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1522475045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306c90bb-0a98-4d79-837e-094c658f14b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:04Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Creating volume 306c90bb-0a98-4d79-837e-094c658f14b9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:06 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:06 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9 1073741824
Apr 20 23:39:06 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-af9f8f9a-8635-4d49-812d-bf3f25efbd31 tempest-GroupsV314Test-2078578187 None] Delete group completed successfully.
Apr 20 23:39:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fc497d8e-5667-4851-87c8-208e471e2a8a tempest-VolumesExtendTest-340455827 None] Create snapshot completed successfully
Apr 20 23:39:06 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.515s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Deleted volume successfully.
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-667068f2-b711-4890-ba6d-924d53e771d6 tempest-VolumesMetadataTest-1960390845 None] Lock "cinder-978a1a48-80ca-44a0-abac-9cd4bb607776-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:06 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9 1073741824" returned: 0 in 0.623s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:06 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9
Apr 20 23:39:06 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:07 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.070s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4ab535-7ae3-4fa3-8552-cd813d20c072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306c90bb-0a98-4d79-837e-094c658f14b9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637486bd-2721-4f60-bab5-ef2f4bfe0d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[37287e75-2e47-474c-b553-15b226f0af5f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Volume volume-306c90bb-0a98-4d79-837e-094c658f14b9 (306c90bb-0a98-4d79-837e-094c658f14b9): created successfully
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637486bd-2721-4f60-bab5-ef2f4bfe0d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (0fd08e28-a05c-4089-93d9-a167b8592835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-491b80bc-551a-404b-bcce-ec9265ffae75 tempest-VolumesActionsTest-1614412969 None] Created volume successfully.
Apr 20 23:39:07 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199
Apr 20 23:39:07 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-306c90bb-0a98-4d79-837e-094c658f14b9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-306c90bb-0a98-4d79-837e-094c658f14b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-quobyte-306c90bb-0a98-4d79-837e-094c658f14b9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-306c90bb-0a98-4d79-837e-094c658f14b9" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80f7e7-767c-4a86-bdfe-ccd0ffd4517d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:07 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9
Apr 20 23:39:07 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:08 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199" returned: 0 in 0.671s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 2G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 2G" returned: 0 in 0.122s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.826s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-650a9a7f-016f-4a5e-a30e-5cf2c470069a tempest-VolumesExtendTest-340455827 None] Extend volume completed successfully.
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-2592b240-15c2-402c-abe4-9ad4e272b380-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Lock "cinder-2592b240-15c2-402c-abe4-9ad4e272b380-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-quobyte-533a72cc-d10c-42bd-becd-dd596c67c199" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:08 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-533a72cc-d10c-42bd-becd-dd596c67c199" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-quobyte-2592b240-15c2-402c-abe4-9ad4e272b380" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9" returned: 0 in 0.739s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-2592b240-15c2-402c-abe4-9ad4e272b380" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Deleting offline snapshot 2592b240-15c2-402c-abe4-9ad4e272b380 of volume 533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:08 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9
Apr 20 23:39:08 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] snapshot_file for this snap is: volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a9683-47d6-48fb-890d-248a57b04329]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:08 devstack sudo[87640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380
Apr 20 23:39:08 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:09 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-306c90bb-0a98-4d79-837e-094c658f14b9" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:09 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-306c90bb-0a98-4d79-837e-094c658f14b9" released by "delete_volume" :: held 1.378s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533a72cc-d10c-42bd-becd-dd596c67c199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c56ae-0de5-4957-9562-612990541eda]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Created reservations ['d836248f-aa4f-4ff1-8826-9ecb801cf960', 'd18ded2e-54fc-456b-a962-12d439e75214', '3dbe327c-4216-4f16-b5c2-4dc1d36ca109', '37cf8c0d-f258-4c6d-b2dc-716de621ec50'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:09 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199
Apr 20 23:39:09 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:09 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:09 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:09 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199" returned: 0 in 0.647s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:09 devstack sudo[87654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380
Apr 20 23:39:09 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:09 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.622s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Deleted volume successfully.
Apr 20 23:39:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ebd902f5-70e2-4476-8cd0-387e15e45a04 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-306c90bb-0a98-4d79-837e-094c658f14b9-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (94c86d54-e679-4fb8-859a-f5f5216036df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb1865a-8eac-462c-94ea-08171345d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb1865a-8eac-462c-94ea-08171345d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013760750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f3f196-e44b-40d0-8f18-15e1d59e4e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:10Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327581f3-bf76-4d2b-8150-4b43513c7ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327581f3-bf76-4d2b-8150-4b43513c7ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d18c0a1-7530-4274-b620-987075341792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d18c0a1-7530-4274-b620-987075341792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f3f196-e44b-40d0-8f18-15e1d59e4e5f', 'volume_name': 'volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443806e-b429-4858-af69-cb684e1df947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443806e-b429-4858-af69-cb684e1df947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5e9a44-436f-451d-95b9-3737c24fd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Volume f1f3f196-e44b-40d0-8f18-15e1d59e4e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f', 'volume_size': 1}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013760750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f3f196-e44b-40d0-8f18-15e1d59e4e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:10Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Creating volume f1f3f196-e44b-40d0-8f18-15e1d59e4e5f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:10 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:10 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f 1073741824
Apr 20 23:39:10 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2dc6ed47-8852-4e62-9ebd-4a4f99b577c1 tempest-GroupsV320Test-700379642 None] Group tempest-GroupsV320Test-Group-755803743: creating
Apr 20 23:39:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2dc6ed47-8852-4e62-9ebd-4a4f99b577c1 tempest-GroupsV320Test-700379642 None] Group tempest-GroupsV320Test-Group-755803743: created successfully
Apr 20 23:39:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2dc6ed47-8852-4e62-9ebd-4a4f99b577c1 tempest-GroupsV320Test-700379642 None] Create group completed successfully.
Apr 20 23:39:10 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380" returned: 0 in 0.708s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:10 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380
Apr 20 23:39:10 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:10 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f 1073741824" returned: 0 in 0.574s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:10 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f
Apr 20 23:39:10 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:10 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199.2592b240-15c2-402c-abe4-9ad4e272b380" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-2592b240-15c2-402c-abe4-9ad4e272b380" released by "_delete_snapshot" :: held 2.505s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-533a72cc-d10c-42bd-becd-dd596c67c199" released by "delete_snapshot" :: held 2.535s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Created reservations ['8c8f98c2-1ed2-4dd0-847f-086026821f53', 'a54495f6-dde9-461e-abb9-ab7e258c6ee8', 'd48f2155-795b-4697-8f65-78593c9b61c2', 'e29b4d46-30c1-4dec-976f-f529b24299a4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Delete snapshot completed successfully.
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7d6a050c-9bfc-4228-9618-7b5b17e42ae9 tempest-VolumesExtendTest-340455827 None] Lock "cinder-2592b240-15c2-402c-abe4-9ad4e272b380-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:11 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5e9a44-436f-451d-95b9-3737c24fd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f44f5c1-d13e-4e00-87cb-916921aaa856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Volume volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f (f1f3f196-e44b-40d0-8f18-15e1d59e4e5f): created successfully
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f44f5c1-d13e-4e00-87cb-916921aaa856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (94c86d54-e679-4fb8-859a-f5f5216036df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-55542147-d234-4d35-b217-cb29311ca2bd tempest-VolumesActionsTest-1614412969 None] Created volume successfully.
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-533a72cc-d10c-42bd-becd-dd596c67c199-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Lock "cinder-533a72cc-d10c-42bd-becd-dd596c67c199-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Acquiring lock "cinder-quobyte-533a72cc-d10c-42bd-becd-dd596c67c199" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-533a72cc-d10c-42bd-becd-dd596c67c199" acquired by "delete_volume" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf5adfe-f303-4533-816c-a908a5087024]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Created reservations ['032e64e2-da4f-4a7e-81a6-652929b2bff9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:11 devstack sudo[87671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199
Apr 20 23:39:11 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:11 devstack sudo[87673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:11 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:12 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199" returned: 0 in 0.609s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:12 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199
Apr 20 23:39:12 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:12 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.656s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-077e844b-33c7-48ee-8515-27f9d90f7d0f tempest-GroupsV320Test-700379642 None] Delete group completed successfully.
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-quobyte-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[987858b6-510e-4a94-8019-22262977cc0d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:12 devstack sudo[87681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f
Apr 20 23:39:12 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:13 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-533a72cc-d10c-42bd-becd-dd596c67c199" returned: 0 in 0.796s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Lock "cinder-quobyte-533a72cc-d10c-42bd-becd-dd596c67c199" released by "delete_volume" :: held 1.433s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Created reservations ['62f98f90-669e-48c7-92b2-b037ce225763', 'edf9c74b-484d-4c33-94e5-d4a55f90dca0', '3e3a0291-c015-4dec-a09c-71740b50ed0a', '4d8ca20c-ce43-40f5-9be1-0b758796a90f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:13 devstack sudo[87687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:13 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:13 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f" returned: 0 in 0.727s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:13 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f
Apr 20 23:39:13 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:14 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f" returned: 0 in 0.611s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:14 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f" released by "delete_volume" :: held 1.367s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.702s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Deleted volume successfully.
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e2073e07-afd4-4480-abe4-f61730355f96 tempest-VolumesExtendTest-340455827 None] Lock "cinder-533a72cc-d10c-42bd-becd-dd596c67c199-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Created reservations ['6b50edac-ab7c-4f48-b12d-6dec3208dbca', '2b31f722-7d93-4204-a176-efb6e2e63f35', '7960b581-ea37-4729-9069-a5be2a1a7285', '52f9045e-9c76-4bef-8859-9821892ec7c6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:14 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:14 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (0e8e0c45-fece-4552-a536-9243f6c1b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411211ee-8bd6-46f7-bda8-d368f0900c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411211ee-8bd6-46f7-bda8-d368f0900c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371552107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78111a-bfdc-4244-98f4-352342c68781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:15Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044ca1be-8ac8-4c0b-a773-475f948633c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044ca1be-8ac8-4c0b-a773-475f948633c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36202581-9c5d-4954-be7c-ebf360f41d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36202581-9c5d-4954-be7c-ebf360f41d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab78111a-bfdc-4244-98f4-352342c68781', 'volume_name': 'volume-ab78111a-bfdc-4244-98f4-352342c68781', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe7de73-a1fe-4039-b321-fb15b2c50d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe7de73-a1fe-4039-b321-fb15b2c50d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25c4978-e906-4140-9de4-ebc1052662c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Volume ab78111a-bfdc-4244-98f4-352342c68781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab78111a-bfdc-4244-98f4-352342c68781', 'volume_size': 1}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371552107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78111a-bfdc-4244-98f4-352342c68781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:15Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Creating volume ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:14 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:14 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.638s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Deleted volume successfully.
Apr 20 23:39:14 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 1073741824
Apr 20 23:39:14 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0f35c441-0253-4b26-b86f-5f5ef85d68d3 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-f1f3f196-e44b-40d0-8f18-15e1d59e4e5f-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (ab898ec8-fb6e-4036-9df1-10a08b3edafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1fee893-b152-4b7c-8a87-78d7a1703b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1fee893-b152-4b7c-8a87-78d7a1703b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-635430670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ff721d-5e61-4289-8753-cdc60ae1510b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:15Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f268fa-e387-4b47-b0b4-1d8aa49f82d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f268fa-e387-4b47-b0b4-1d8aa49f82d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a084a27-fa69-4401-99bc-3135e3b971fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a084a27-fa69-4401-99bc-3135e3b971fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ff721d-5e61-4289-8753-cdc60ae1510b', 'volume_name': 'volume-d4ff721d-5e61-4289-8753-cdc60ae1510b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d01cce-53c1-46a4-961b-6ed0066e5f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d01cce-53c1-46a4-961b-6ed0066e5f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a61b221-83e2-41d9-9c5c-e4c1389d5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Volume d4ff721d-5e61-4289-8753-cdc60ae1510b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ff721d-5e61-4289-8753-cdc60ae1510b', 'volume_size': 1}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:15 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 1073741824" returned: 0 in 0.712s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:15 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781
Apr 20 23:39:15 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:15 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:15 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:16 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-635430670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ff721d-5e61-4289-8753-cdc60ae1510b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:15Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Creating volume d4ff721d-5e61-4289-8753-cdc60ae1510b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:16 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25c4978-e906-4140-9de4-ebc1052662c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab78111a-bfdc-4244-98f4-352342c68781', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd80d9dc-e307-4ace-ab43-5bfbc2a80441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Volume volume-ab78111a-bfdc-4244-98f4-352342c68781 (ab78111a-bfdc-4244-98f4-352342c68781): created successfully
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd80d9dc-e307-4ace-ab43-5bfbc2a80441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (0e8e0c45-fece-4552-a536-9243f6c1b999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:16 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b 1073741824
Apr 20 23:39:16 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-95a1476b-ffab-4bc9-92e9-339912e9bd8c tempest-VolumesSnapshotTestJSON-828142989 None] Created volume successfully.
Apr 20 23:39:16 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.568s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:16 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b 1073741824" returned: 0 in 0.710s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:16 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b
Apr 20 23:39:16 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:17 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.440s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Creating offline snapshot 48810d0b-7317-44af-87c9-207ae56c9c49 of volume ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a61b221-83e2-41d9-9c5c-e4c1389d5f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ff721d-5e61-4289-8753-cdc60ae1510b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87544ebf-c346-4d96-99d6-746909b995ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eef8f5-4163-42aa-ba2e-3bfcf9a856d4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Volume volume-d4ff721d-5e61-4289-8753-cdc60ae1510b (d4ff721d-5e61-4289-8753-cdc60ae1510b): created successfully
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87544ebf-c346-4d96-99d6-746909b995ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (ab898ec8-fb6e-4036-9df1-10a08b3edafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5ebd963d-19c9-4dbd-80c1-3b2eff30e373 tempest-VolumesActionsTest-1614412969 None] Created volume successfully.
Apr 20 23:39:17 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781
Apr 20 23:39:17 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Flow 'volume_create_manager' (52eea217-7362-4079-8db6-5acf4998b749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effb0179-0b6e-4ffb-9ef8-d1e28245ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effb0179-0b6e-4ffb-9ef8-d1e28245ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-806414190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02da4adf-0033-49a9-aa49-1921d3ace3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a0c07438d140d0abd8e7da55e884fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:18Z,use_quota=True,user_id='788ccdb8a2674e788fb1615a7661dbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea347091-0fb0-41ed-964f-d65363df682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea347091-0fb0-41ed-964f-d65363df682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5060d90-e123-4a3f-9ad2-7122a4f00995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5060d90-e123-4a3f-9ad2-7122a4f00995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02da4adf-0033-49a9-aa49-1921d3ace3a6', 'volume_name': 'volume-02da4adf-0033-49a9-aa49-1921d3ace3a6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f971517a-cce2-4950-bff4-e8d69fe9f1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f971517a-cce2-4950-bff4-e8d69fe9f1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0fad30-1aa2-4a52-bb15-2448cdb8ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Volume 02da4adf-0033-49a9-aa49-1921d3ace3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02da4adf-0033-49a9-aa49-1921d3ace3a6', 'volume_size': 1}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Flow 'volume_create_manager' (b1512d68-342d-45b2-802e-cc44ecd2c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad07edc-1200-4431-bdec-d05f9a03b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad07edc-1200-4431-bdec-d05f9a03b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-669964379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8348600b-6b9b-4ed5-b3d8-854f983f91fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236b5eb99c9148448b5882a7302d7112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:18Z,use_quota=True,user_id='a5037df62fe541d1951d1be5788e0b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c9ba57-fef6-4633-9da6-e1bf47f4c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c9ba57-fef6-4633-9da6-e1bf47f4c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d944ad-365a-40bc-9c98-520394aa4b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d944ad-365a-40bc-9c98-520394aa4b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8348600b-6b9b-4ed5-b3d8-854f983f91fb', 'volume_name': 'volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6ce889-a886-4b0d-8d5d-0590146087c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6ce889-a886-4b0d-8d5d-0590146087c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21589e8-e280-4c6e-b725-05e6d15a741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:18 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Volume 8348600b-6b9b-4ed5-b3d8-854f983f91fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb', 'volume_size': 1}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:18 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:18 devstack sudo[87721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 1G
Apr 20 23:39:18 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-d4ff721d-5e61-4289-8753-cdc60ae1510b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Lock "cinder-d4ff721d-5e61-4289-8753-cdc60ae1510b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-quobyte-d4ff721d-5e61-4289-8753-cdc60ae1510b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-d4ff721d-5e61-4289-8753-cdc60ae1510b" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384f7d4-1013-46f3-90f7-715ab834a0e0]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:18 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 1G" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab78111a-bfdc-4244-98f4-352342c68781 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:18 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab78111a-bfdc-4244-98f4-352342c68781 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49
Apr 20 23:39:18 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:18 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b
Apr 20 23:39:18 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:19 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab78111a-bfdc-4244-98f4-352342c68781 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:19 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 is being set with open permissions: ugo+rw
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:19 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:19 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49
Apr 20 23:39:19 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:19 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b
Apr 20 23:39:19 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:19 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:19 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d4ff721d-5e61-4289-8753-cdc60ae1510b" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-d4ff721d-5e61-4289-8753-cdc60ae1510b" released by "delete_volume" :: held 0.927s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:19 devstack sudo[87748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info
Apr 20 23:39:19 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Created reservations ['53cd0de5-dafd-4f4e-97d1-39f2bba5db85', '55b7e708-e0a1-4443-aa58-1f705d27241f', 'b408d17f-4709-41c6-afcc-5ae442c0c395', '2de203b2-f28a-4413-9a74-d86a5591ddb9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:19 devstack sudo[87750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:19 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (12b13998-82c0-4f37-9a43-aeb6487cbc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a040bcf-9293-4195-b558-05943c7f0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a040bcf-9293-4195-b558-05943c7f0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-235548249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:20Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba34c7-fd9f-4ac1-a981-03115cbcc0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cba34c7-fd9f-4ac1-a981-03115cbcc0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3ecc95-d644-40f3-aa85-6ec11d6fe156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3ecc95-d644-40f3-aa85-6ec11d6fe156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c', 'volume_name': 'volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7707ca56-a613-479b-b221-511e1630e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7707ca56-a613-479b-b221-511e1630e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1481098-bdef-4454-b382-4a356fee2b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:19 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Volume b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c', 'volume_size': 1}
Apr 20 23:39:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:20 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:20 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info is being set with open permissions: ugo+rw
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:20 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info
Apr 20 23:39:20 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:20 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Deleted volume successfully.
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a3bd6cc7-c203-41e0-815c-2d906373c5ec tempest-VolumesActionsTest-1510962409 None] Lock "cinder-d4ff721d-5e61-4289-8753-cdc60ae1510b-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:20 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.info" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.576s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-806414190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02da4adf-0033-49a9-aa49-1921d3ace3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a0c07438d140d0abd8e7da55e884fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:18Z,use_quota=True,user_id='788ccdb8a2674e788fb1615a7661dbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Creating volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:20 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:20 devstack sudo[87757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 1073741824
Apr 20 23:39:20 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-25b5f691-e969-4e2f-847b-ff6eb33d8345 tempest-VolumesSnapshotTestJSON-828142989 None] Create snapshot completed successfully
Apr 20 23:39:20 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 1073741824" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:21 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6
Apr 20 23:39:21 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-48810d0b-7317-44af-87c9-207ae56c9c49-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-48810d0b-7317-44af-87c9-207ae56c9c49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-ab78111a-bfdc-4244-98f4-352342c68781" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-ab78111a-bfdc-4244-98f4-352342c68781" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-48810d0b-7317-44af-87c9-207ae56c9c49" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-48810d0b-7317-44af-87c9-207ae56c9c49" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Deleting offline snapshot 48810d0b-7317-44af-87c9-207ae56c9c49 of volume ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] snapshot_file for this snap is: volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f17f5-a407-46ae-ae06-704f36d5e98b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:21 devstack sudo[87764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49
Apr 20 23:39:21 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:21 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.391s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-669964379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8348600b-6b9b-4ed5-b3d8-854f983f91fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236b5eb99c9148448b5882a7302d7112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:18Z,use_quota=True,user_id='a5037df62fe541d1951d1be5788e0b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Creating volume 8348600b-6b9b-4ed5-b3d8-854f983f91fb {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:21 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0fad30-1aa2-4a52-bb15-2448cdb8ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02da4adf-0033-49a9-aa49-1921d3ace3a6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:21 devstack sudo[87767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb 1073741824
Apr 20 23:39:21 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ce8e86-8ee6-4ba6-a347-75a5303250f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Volume volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 (02da4adf-0033-49a9-aa49-1921d3ace3a6): created successfully
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ce8e86-8ee6-4ba6-a347-75a5303250f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Flow 'volume_create_manager' (52eea217-7362-4079-8db6-5acf4998b749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2d64c90d-9b21-45e5-988e-15d134bed629 tempest-SnapshotsActionsTest-190346153 None] Created volume successfully.
Apr 20 23:39:21 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab78111a-bfdc-4244-98f4-352342c68781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b9aec-1e53-4865-89f3-aeb3faf3be5b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:21 devstack sudo[87775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781
Apr 20 23:39:21 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:21 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb 1073741824" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:22 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb
Apr 20 23:39:22 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:22 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781" returned: 0 in 0.550s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:22 devstack sudo[87782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49
Apr 20 23:39:22 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:22 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.549s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-235548249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:20Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Creating volume b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:22 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21589e8-e280-4c6e-b725-05e6d15a741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:22 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c 1073741824
Apr 20 23:39:22 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f0130a-1c4b-46a6-8ff0-2c4a0bdada1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Volume volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb (8348600b-6b9b-4ed5-b3d8-854f983f91fb): created successfully
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f0130a-1c4b-46a6-8ff0-2c4a0bdada1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Flow 'volume_create_manager' (b1512d68-342d-45b2-802e-cc44ecd2c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-17e893cb-d7c3-457c-9607-019a3bb0265f tempest-VolumesNegativeTest-1551635320 None] Created volume successfully.
Apr 20 23:39:22 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:22 devstack sudo[87790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49
Apr 20 23:39:22 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:23 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c 1073741824" returned: 0 in 0.523s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:23 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c
Apr 20 23:39:23 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:23 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781.48810d0b-7317-44af-87c9-207ae56c9c49" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-48810d0b-7317-44af-87c9-207ae56c9c49" released by "_delete_snapshot" :: held 2.050s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-ab78111a-bfdc-4244-98f4-352342c68781" released by "delete_snapshot" :: held 2.061s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['c7335414-ae78-49f0-829e-cb5b76b5d55a', '6af37664-ca22-4be1-b13a-de7c0af1f9ae', '327977f1-a2bc-4092-86ae-e8a4eedda946', 'e67691bf-6aed-45b5-8e24-8abd8242fc58'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Delete snapshot completed successfully.
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e0ec1e3-15b4-4c84-b29e-6437128b22bd tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-48810d0b-7317-44af-87c9-207ae56c9c49-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:23 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c" returned: 0 in 0.490s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.389s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Creating offline snapshot 2b33e900-8c16-4c7a-88fa-1e9a5c053011 of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1481098-bdef-4454-b382-4a356fee2b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bf3cc6-c516-4763-b6c3-92105e83c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[928e99e4-1419-4e28-85ad-b3ef717e2c39]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Volume volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c (b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c): created successfully
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bf3cc6-c516-4763-b6c3-92105e83c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (12b13998-82c0-4f37-9a43-aeb6487cbc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-15d0c0d0-b146-4a66-a66d-a1ad339f2742 tempest-VolumesActionsTest-1614412969 None] Created volume successfully.
Apr 20 23:39:23 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6
Apr 20 23:39:23 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:24 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:24 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 1G
Apr 20 23:39:24 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "cinder-quobyte-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[62159259-1092-4871-89c9-abe0ca96340c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:24 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c
Apr 20 23:39:24 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:24 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 1G" returned: 0 in 0.556s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:24 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:24 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (090044e2-43d2-4e89-b0bc-f973349ec81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec700e69-101e-4fb6-b2e6-b84f8e680319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec700e69-101e-4fb6-b2e6-b84f8e680319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109319826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab8a874-8edc-4250-bee0-f0a46260183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:25Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b476cdc-4522-4a56-8dba-4c6b40208b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b476cdc-4522-4a56-8dba-4c6b40208b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe374df-c7ff-499b-b9c2-aa0f63b62829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe374df-c7ff-499b-b9c2-aa0f63b62829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab8a874-8edc-4250-bee0-f0a46260183d', 'volume_name': 'volume-4ab8a874-8edc-4250-bee0-f0a46260183d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70860284-8890-4208-a279-3a4b35d3712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70860284-8890-4208-a279-3a4b35d3712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ee672c-be15-44b2-82ba-b70eaae890ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Volume 4ab8a874-8edc-4250-bee0-f0a46260183d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab8a874-8edc-4250-bee0-f0a46260183d', 'volume_size': 1}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:24 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:24 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c
Apr 20 23:39:24 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:25 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:25 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 is being set with open permissions: ugo+rw
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:25 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:25 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:25 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-quobyte-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c" released by "delete_volume" :: held 1.017s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Created reservations ['bfcf55e8-0c4b-40e0-8f5f-863ec0aa3bff', '77cd623c-6ab9-45bf-94dc-b1675c419155', '1367b820-e1c2-4bac-9202-5a70ee1f406a', 'e82c52a7-4586-41e9-943f-93046583e5e3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:25 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:25 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:25 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:25 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info
Apr 20 23:39:25 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:25 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Deleted volume successfully.
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7532da58-0012-483d-8373-2fe919a71a90 tempest-VolumesActionsTest-1510962409 None] Lock "cinder-b78dfc4a-fc01-49ce-a7cd-aa85f9141f3c-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:25 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:25 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info is being set with open permissions: ugo+rw
Apr 20 23:39:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:26 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info
Apr 20 23:39:26 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:26 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.info" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.867s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109319826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab8a874-8edc-4250-bee0-f0a46260183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:25Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Creating volume 4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:26 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=241,cinder:SELECT=213,cinder:INSERT=67,cinder:DELETE=14 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:39:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f942e986-ac06-4076-8668-b8ab0a585e0c tempest-SnapshotsActionsTest-190346153 None] Create snapshot completed successfully
Apr 20 23:39:26 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d 1073741824
Apr 20 23:39:26 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (70afb63a-6fad-4220-9562-449a8bf9c312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07de91f3-c59d-4add-b171-39a14b17dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07de91f3-c59d-4add-b171-39a14b17dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-803737843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62575c29-c42a-4890-af0a-248273224e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:27Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc3cb52-82e5-443c-bd2b-73987f77df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc3cb52-82e5-443c-bd2b-73987f77df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28364dc3-6e09-4da2-a787-061cbbf5c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28364dc3-6e09-4da2-a787-061cbbf5c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62575c29-c42a-4890-af0a-248273224e68', 'volume_name': 'volume-62575c29-c42a-4890-af0a-248273224e68', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f365723d-8e76-4145-a0e7-497086827df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f365723d-8e76-4145-a0e7-497086827df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615a2b57-287e-402a-b557-653143d0303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Volume 62575c29-c42a-4890-af0a-248273224e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62575c29-c42a-4890-af0a-248273224e68', 'volume_size': 1}
Apr 20 23:39:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:26 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d 1073741824" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:27 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:27 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:27 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.428s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-803737843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62575c29-c42a-4890-af0a-248273224e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a82d88be7b64a5b83bd51f52f5f3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:27Z,use_quota=True,user_id='79b9c00ae51044db9751073dd7a1c1df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Creating volume 62575c29-c42a-4890-af0a-248273224e68 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:27 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ee672c-be15-44b2-82ba-b70eaae890ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab8a874-8edc-4250-bee0-f0a46260183d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:27 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68 1073741824
Apr 20 23:39:27 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392be1bb-abed-467f-93d0-9835ea8497e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Volume volume-4ab8a874-8edc-4250-bee0-f0a46260183d (4ab8a874-8edc-4250-bee0-f0a46260183d): created successfully
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392be1bb-abed-467f-93d0-9835ea8497e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (090044e2-43d2-4e89-b0bc-f973349ec81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2cb6a79a-d361-4cb8-a810-60c4bb406df3 tempest-VolumesSnapshotTestJSON-828142989 None] Created volume successfully.
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=252,cinder:SELECT=220,cinder:DELETE=21,cinder:INSERT=62 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:39:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:28 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68 1073741824" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:28 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68
Apr 20 23:39:28 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:28 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.618s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615a2b57-287e-402a-b557-653143d0303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62575c29-c42a-4890-af0a-248273224e68', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabb1b32-e669-4f81-9c1d-d0128688b91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Creating offline snapshot d29fa9de-f51f-44af-8498-91ca4aad4c58 of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Volume volume-62575c29-c42a-4890-af0a-248273224e68 (62575c29-c42a-4890-af0a-248273224e68): created successfully
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabb1b32-e669-4f81-9c1d-d0128688b91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Flow 'volume_create_manager' (70afb63a-6fad-4220-9562-449a8bf9c312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b66a3-afce-42d1-a943-aca0991f36d5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3d0a260b-649c-4f24-82bf-b862ec8e4994 tempest-VolumesActionsTest-1614412969 None] Created volume successfully.
Apr 20 23:39:28 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:28 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:29 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.653s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:29 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 1G
Apr 20 23:39:29 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "cinder-62575c29-c42a-4890-af0a-248273224e68-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Lock "cinder-62575c29-c42a-4890-af0a-248273224e68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "cinder-quobyte-62575c29-c42a-4890-af0a-248273224e68" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Lock "cinder-quobyte-62575c29-c42a-4890-af0a-248273224e68" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bfe401-a07b-46dc-8358-09cfccf12bbc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:29 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68
Apr 20 23:39:29 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:29 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 1G" returned: 0 in 0.608s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:29 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58
Apr 20 23:39:29 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:29 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:29 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68
Apr 20 23:39:29 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:30 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:30 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 is being set with open permissions: ugo+rw
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:30 devstack sudo[87928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58
Apr 20 23:39:30 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:30 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-62575c29-c42a-4890-af0a-248273224e68" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Lock "cinder-quobyte-62575c29-c42a-4890-af0a-248273224e68" released by "delete_volume" :: held 1.012s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Created reservations ['514b9a28-a558-478c-8ec7-8b481ac96391', 'db7e1a66-9705-480e-94b8-084787997fe4', 'ceccbf80-21ca-45a6-9b91-e69f8f742f56', '52819b85-786f-4dc2-977f-0c14e1106a96'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:30 devstack sudo[87932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:30 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:30 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.685s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Creating offline snapshot 8c7feec6-8843-4d40-a8b9-31b718966e3b of volume 4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-27d1c236-d18b-4e43-a200-5c68e791274d tempest-SnapshotsActionsTest-190346153 None] Create snapshot completed successfully
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a366d3-ea92-4acd-ada1-318f2d7d217a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:30 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:30 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:30 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Deleted volume successfully.
Apr 20 23:39:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c466ed03-20e4-45b8-be85-ee7b50140ae3 tempest-VolumesActionsTest-1614412969 None] Lock "cinder-62575c29-c42a-4890-af0a-248273224e68-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-d29fa9de-f51f-44af-8498-91ca4aad4c58-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-d29fa9de-f51f-44af-8498-91ca4aad4c58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-d29fa9de-f51f-44af-8498-91ca4aad4c58" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-d29fa9de-f51f-44af-8498-91ca4aad4c58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Deleting offline snapshot d29fa9de-f51f-44af-8498-91ca4aad4c58 of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] snapshot_file for this snap is: volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28d75bc-234d-4635-8fd9-f605df3a3f1a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:31 devstack sudo[87938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58
Apr 20 23:39:31 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:31 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:31 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b 1G
Apr 20 23:39:31 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:31 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d7473-10cc-4a81-be19-5e16a486c47d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:31 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:31 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:31 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b 1G" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab8a874-8edc-4250-bee0-f0a46260183d -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:31 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab8a874-8edc-4250-bee0-f0a46260183d -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b
Apr 20 23:39:31 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:32 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.587s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:32 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58
Apr 20 23:39:32 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:32 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab8a874-8edc-4250-bee0-f0a46260183d -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:32 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b is being set with open permissions: ugo+rw
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:32 devstack sudo[87963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b
Apr 20 23:39:32 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:32 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:32 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58
Apr 20 23:39:32 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:32 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:32 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info
Apr 20 23:39:32 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:33 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.d29fa9de-f51f-44af-8498-91ca4aad4c58" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-d29fa9de-f51f-44af-8498-91ca4aad4c58" released by "_delete_snapshot" :: held 2.154s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" released by "delete_snapshot" :: held 2.177s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Created reservations ['bd8c08d9-df04-4635-b5e6-e6a0a3f17a28', '33f3b6e4-9983-4c51-828e-d13632e7d7e1', '999a744f-fcc3-4c1b-b2cc-bff613e400c7', '76dd0900-a661-4e29-8811-c9e36ac693e3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Delete snapshot completed successfully.
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2bf493dc-ed45-4434-8d8b-ec1db1d0a1eb tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-d29fa9de-f51f-44af-8498-91ca4aad4c58-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:33 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:33 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info is being set with open permissions: ugo+rw
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:33 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info
Apr 20 23:39:33 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:33 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.info" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5c1e3605-d73e-4a45-996c-697a44a5c811 tempest-VolumesSnapshotTestJSON-828142989 None] Create snapshot completed successfully
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Creating offline snapshot 1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (101e074a-202f-498a-bbaf-c77a0f7734a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f08f479-2b6d-4953-bfe3-f4e9ee5d9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b5d9c-d0fd-4894-a946-ab9ba46c5dd2]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f08f479-2b6d-4953-bfe3-f4e9ee5d9fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1052193901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabe0060-be9e-437b-bb0f-fc5ccf6d0995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8c7feec6-8843-4d40-a8b9-31b718966e3b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:35Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e459d9b-152b-4528-8681-ece0061d40f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e459d9b-152b-4528-8681-ece0061d40f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640ab1bf-af92-470c-ad55-34195fa05a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640ab1bf-af92-470c-ad55-34195fa05a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aabe0060-be9e-437b-bb0f-fc5ccf6d0995', 'volume_name': 'volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995', 'volume_size': 2, 'snapshot_id': '8c7feec6-8843-4d40-a8b9-31b718966e3b'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4644763c-c9c7-4d0d-884e-9bd8562885c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4644763c-c9c7-4d0d-884e-9bd8562885c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350e570a-798c-46fa-aa34-93fd20c9da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Volume aabe0060-be9e-437b-bb0f-fc5ccf6d0995: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995', 'volume_size': 2, 'snapshot_id': '8c7feec6-8843-4d40-a8b9-31b718966e3b'}
Apr 20 23:39:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:34 devstack sudo[88010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:34 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:35 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.691s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:35 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 1G
Apr 20 23:39:35 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:36 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 1G" returned: 0 in 0.587s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:36 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9
Apr 20 23:39:36 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:36 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" returned: 0 in 0.527s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:36 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 is being set with open permissions: ugo+rw
Apr 20 23:39:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:36 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9
Apr 20 23:39:36 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:37 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" returned: 0 in 0.532s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.296s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-8c7feec6-8843-4d40-a8b9-31b718966e3b-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-288bc8dc-9d77-44b6-b9ec-97fd0eac2334 tempest-SnapshotsActionsTest-190346153 None] Create snapshot completed successfully
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8c7feec6-8843-4d40-a8b9-31b718966e3b-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Creating volume aabe0060-be9e-437b-bb0f-fc5ccf6d0995 from snapshot 8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] snapshot: 8c7feec6-8843-4d40-a8b9-31b718966e3b, volume: aabe0060-be9e-437b-bb0f-fc5ccf6d0995,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064869f-08b4-4fd0-9098-2747e2e2b110]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:37 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b
Apr 20 23:39:37 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:37 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab8a874-8edc-4250-bee0-f0a46260183d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1be9f6-4125-4505-aca9-cc2af0b9bc8c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:38 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:38 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Deleting offline snapshot 1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] snapshot_file for this snap is: volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd83cb-43f6-447e-aa6f-467768080d49]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:38 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9
Apr 20 23:39:38 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:38 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.591s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:38 devstack sudo[88076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995
Apr 20 23:39:38 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:38 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" returned: 0 in 0.660s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b941b7cc-5263-49fd-bc90-37e219caae30]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:38 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:38 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:39 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.837s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:39 devstack sudo[88099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9
Apr 20 23:39:39 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:41 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" returned: 0 in 1.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:41 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9
Apr 20 23:39:41 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:41 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" returned: 0 in 2.556s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f7e964-7524-4e2b-b688-cc5da87c5d33]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:41 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:41 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:41 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9" released by "_delete_snapshot" :: held 3.479s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" released by "delete_snapshot" :: held 3.509s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Created reservations ['874e6848-21af-4ff4-9817-b6af8ddda3d7', '07f73f2e-6f1a-4ba3-8e6f-09a56d26a4d7', 'dece1318-4f91-4da7-9a53-7d9d7d2da9c8', '2509e98f-5264-4983-85b5-90e41698dc75'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Delete snapshot completed successfully.
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c5316de6-56ab-4645-9ba6-776f31174b45 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-1a5e7cf1-ef9a-4852-8481-d9c4f74dc5e9-delete_snapshot" released by "delete_snapshot" :: held 3.619s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:41 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.686s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:39:41 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Converted 1024.00 MB image at 400.39 MB/s
Apr 20 23:39:41 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 is being set with open permissions: ugo+rw
Apr 20 23:39:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:41 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995
Apr 20 23:39:41 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:42 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" released by "_copy_volume_from_snapshot" :: held 4.953s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8c7feec6-8843-4d40-a8b9-31b718966e3b-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" released by "_create_volume_from_snapshot" :: held 4.978s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.998s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350e570a-798c-46fa-aa34-93fd20c9da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995', 'volume_size': 2, 'snapshot_id': '8c7feec6-8843-4d40-a8b9-31b718966e3b'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed34bfe7-f3aa-4d49-86fd-6f54149ec397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Volume volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 (aabe0060-be9e-437b-bb0f-fc5ccf6d0995): created successfully
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed34bfe7-f3aa-4d49-86fd-6f54149ec397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (101e074a-202f-498a-bbaf-c77a0f7734a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bc4cf291-d840-4748-a9ca-1332d3a8bf13 tempest-VolumesSnapshotTestJSON-828142989 None] Created volume successfully.
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Creating offline snapshot 11768dcb-3a78-40fe-a9d6-57fe5e9517bb of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8938305-f185-4c61-957d-062072407aa4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:42 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:42 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:42 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:43 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb 1G
Apr 20 23:39:43 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-aabe0060-be9e-437b-bb0f-fc5ccf6d0995-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-aabe0060-be9e-437b-bb0f-fc5ccf6d0995-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b78f26-39bb-4933-8592-70d2f6b237fd]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:43 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995
Apr 20 23:39:43 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:43 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb 1G" returned: 0 in 0.614s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:43 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb
Apr 20 23:39:43 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:43 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:43 devstack sudo[88133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995
Apr 20 23:39:43 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Flow 'volume_create_manager' (fc831baa-7782-4b78-858a-8217d6dd32ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacdb1e6-590b-4ec3-970c-de1c19fca0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacdb1e6-590b-4ec3-970c-de1c19fca0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-243084836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84e953a-3877-493d-9c5b-246cc3e3b2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f403ee71f74704b7b66ae7aa8ab1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:44Z,use_quota=True,user_id='0a702ecaa2a6419092d05e75415fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d03ac0-4b51-4a1d-8a7c-8b3937fda883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d03ac0-4b51-4a1d-8a7c-8b3937fda883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:44 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7429abd-bf2b-4bb6-801a-4e483b54a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7429abd-bf2b-4bb6-801a-4e483b54a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84e953a-3877-493d-9c5b-246cc3e3b2a6', 'volume_name': 'volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec94b035-7eed-41c6-b584-b976d82bc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec94b035-7eed-41c6-b584-b976d82bc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7757419-2411-4cd9-9ae1-815531bc5e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Volume d84e953a-3877-493d-9c5b-246cc3e3b2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6', 'volume_size': 1}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb is being set with open permissions: ugo+rw
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:44 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb
Apr 20 23:39:44 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:44 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-aabe0060-be9e-437b-bb0f-fc5ccf6d0995" released by "delete_volume" :: held 0.997s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['4e301230-8cf3-4b30-bcac-cda0959b4c33', 'c0eb0349-626d-4fee-bef4-22d2f46f4956', 'b86ea821-a501-4eff-b43d-1795a3c0b3e2', '76ab5de3-d6b7-445a-87dd-d4bfbd4930cd'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:44 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:44 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:44 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-243084836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84e953a-3877-493d-9c5b-246cc3e3b2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f403ee71f74704b7b66ae7aa8ab1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:44Z,use_quota=True,user_id='0a702ecaa2a6419092d05e75415fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Creating volume d84e953a-3877-493d-9c5b-246cc3e3b2a6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:44 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:44 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 1073741824
Apr 20 23:39:44 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-603961ae-c91a-4bb3-b42c-ffa0ab0e35f8 tempest-SnapshotsActionsTest-190346153 None] Create snapshot completed successfully
Apr 20 23:39:44 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Deleted volume successfully.
Apr 20 23:39:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6e6d8c79-5841-4cd9-a245-cebef1a7a335 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-aabe0060-be9e-437b-bb0f-fc5ccf6d0995-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:45 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 1073741824" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:45 devstack sudo[88150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6
Apr 20 23:39:45 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:45 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7757419-2411-4cd9-9ae1-815531bc5e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4845fe-aafd-4931-8b55-81dd32c52fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-8c7feec6-8843-4d40-a8b9-31b718966e3b-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Volume volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 (d84e953a-3877-493d-9c5b-246cc3e3b2a6): created successfully
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4845fe-aafd-4931-8b55-81dd32c52fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Flow 'volume_create_manager' (fc831baa-7782-4b78-858a-8217d6dd32ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-11768dcb-3a78-40fe-a9d6-57fe5e9517bb-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-8c7feec6-8843-4d40-a8b9-31b718966e3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-4ab8a874-8edc-4250-bee0-f0a46260183d" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3dff14b0-a0ee-44f3-808f-6427f1daf602 tempest-VolumesTransfersTest-492519350 None] Created volume successfully.
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-11768dcb-3a78-40fe-a9d6-57fe5e9517bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-4ab8a874-8edc-4250-bee0-f0a46260183d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-8c7feec6-8843-4d40-a8b9-31b718966e3b" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-11768dcb-3a78-40fe-a9d6-57fe5e9517bb" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8c7feec6-8843-4d40-a8b9-31b718966e3b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Deleting offline snapshot 8c7feec6-8843-4d40-a8b9-31b718966e3b of volume 4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] snapshot_file for this snap is: volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-11768dcb-3a78-40fe-a9d6-57fe5e9517bb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Deleting offline snapshot 11768dcb-3a78-40fe-a9d6-57fe5e9517bb of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] snapshot_file for this snap is: volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f509765-97f6-4ee9-9b1f-15e949999f83]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[25927f31-cca5-4afe-aed7-1057d789f5cc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:45 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb
Apr 20 23:39:45 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:45 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b
Apr 20 23:39:45 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:46 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb" returned: 0 in 0.549s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b94f83-09c6-4083-859a-c194629ca599]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:46 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b" returned: 0 in 0.597s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab8a874-8edc-4250-bee0-f0a46260183d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa26c5a-acd1-4ba1-a995-f8afbcaf04b4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:46 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:46 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:46 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:46 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-46ae4426-a0a9-42a6-96ba-ed8311df8bc3 tempest-VolumesTransfersTest-221099723 None] Transfer volume completed successfully.
Apr 20 23:39:46 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.595s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:46 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb
Apr 20 23:39:46 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:46 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.591s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:46 devstack sudo[88177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b
Apr 20 23:39:46 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:47 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb" returned: 0 in 0.573s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:47 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Acquiring lock "cinder-d84e953a-3877-493d-9c5b-246cc3e3b2a6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b" returned: 0 in 0.578s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:47 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb
Apr 20 23:39:47 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Lock "cinder-d84e953a-3877-493d-9c5b-246cc3e3b2a6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:47 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b
Apr 20 23:39:47 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Acquiring lock "cinder-quobyte-d84e953a-3877-493d-9c5b-246cc3e3b2a6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Lock "cinder-quobyte-d84e953a-3877-493d-9c5b-246cc3e3b2a6" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ce648-6bdf-40b3-8915-c31824a05aa3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:47 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6
Apr 20 23:39:47 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:47 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d.8c7feec6-8843-4d40-a8b9-31b718966e3b" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:47 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.11768dcb-3a78-40fe-a9d6-57fe5e9517bb" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-11768dcb-3a78-40fe-a9d6-57fe5e9517bb" released by "_delete_snapshot" :: held 2.317s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8c7feec6-8843-4d40-a8b9-31b718966e3b" released by "_delete_snapshot" :: held 2.334s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" released by "delete_snapshot" :: held 2.340s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-4ab8a874-8edc-4250-bee0-f0a46260183d" released by "delete_snapshot" :: held 2.349s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['dc88cd31-7504-4fdf-800c-ef9b11fc354e', 'd26d6e13-0d39-43d7-a652-f9935286bbf1', '441b0396-5036-43d1-bd2d-b7120cf2ce63', '14a206bd-cba0-4cf4-a298-affaf428075e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Created reservations ['406cdab9-43b1-4aae-a233-01a8e4791c47', '81cc39cb-ac54-44e3-af16-f0d0cc85c09f', 'b882362d-967b-4682-9d69-b9e7f5b2c036', 'd28e3325-b6d6-49dc-b194-f931c86d74a0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:48 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:48 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6
Apr 20 23:39:48 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Delete snapshot completed successfully.
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-384861d2-3a3f-4406-bc5f-13c9d8c11962 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-8c7feec6-8843-4d40-a8b9-31b718966e3b-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Delete snapshot completed successfully.
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c17311f4-f8ea-45e6-9ad4-9f3eee2cc941 tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-11768dcb-3a78-40fe-a9d6-57fe5e9517bb-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:48 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d84e953a-3877-493d-9c5b-246cc3e3b2a6" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Lock "cinder-quobyte-d84e953a-3877-493d-9c5b-246cc3e3b2a6" released by "delete_volume" :: held 1.022s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Created reservations ['14a879f4-d7d1-4a71-bec4-29b8ab2523c5', '675e2d13-662b-44ac-ae76-2b8fc1c76101', 'dbea2000-999f-4981-a96e-b31d6457181f', '23e857b0-f225-44e0-80db-0a79c62f4f87'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:48 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:48 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-4ab8a874-8edc-4250-bee0-f0a46260183d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-4ab8a874-8edc-4250-bee0-f0a46260183d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-4ab8a874-8edc-4250-bee0-f0a46260183d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-4ab8a874-8edc-4250-bee0-f0a46260183d" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb9e60-0c19-4edd-b786-168d8409f76d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:49 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:49 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:49 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Deleted volume successfully.
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Creating offline snapshot da1f4af0-e657-4026-b7cf-85cf3a351c8c of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-55c204e3-0e23-4f65-98d9-607342f7cbfa tempest-VolumesTransfersTest-302997598 None] Lock "cinder-d84e953a-3877-493d-9c5b-246cc3e3b2a6-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ee87e-5d9f-475f-96bb-2877a7220b21]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:49 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:49 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Acquiring lock "cinder-8348600b-6b9b-4ed5-b3d8-854f983f91fb-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Lock "cinder-8348600b-6b9b-4ed5-b3d8-854f983f91fb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Acquiring lock "cinder-quobyte-8348600b-6b9b-4ed5-b3d8-854f983f91fb" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Lock "cinder-quobyte-8348600b-6b9b-4ed5-b3d8-854f983f91fb" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075ffe7-ab2d-467d-832f-6496a8bcddac]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:49 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb
Apr 20 23:39:49 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:49 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.585s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:49 devstack sudo[88212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d
Apr 20 23:39:49 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:49 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:49 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c 1G
Apr 20 23:39:49 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:49 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:49 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:49 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb
Apr 20 23:39:49 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Flow 'volume_create_manager' (de0a7991-95e9-41a5-8ac1-e998f3648f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1c9f0a-6484-4b56-8f30-9ff5b86c11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4ab8a874-8edc-4250-bee0-f0a46260183d" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1c9f0a-6484-4b56-8f30-9ff5b86c11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1464809685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce821f1e-98e2-40c2-9a3f-c9046e6327ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f403ee71f74704b7b66ae7aa8ab1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:50Z,use_quota=True,user_id='0a702ecaa2a6419092d05e75415fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e599a1-d890-4a3d-acac-8cdf6814973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e599a1-d890-4a3d-acac-8cdf6814973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab98b1c-97a1-4ba7-b342-e7bed0dbef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab98b1c-97a1-4ba7-b342-e7bed0dbef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce821f1e-98e2-40c2-9a3f-c9046e6327ff', 'volume_name': 'volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fdcc30-c261-4cc6-8af5-bbd5d9dbe10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fdcc30-c261-4cc6-8af5-bbd5d9dbe10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72032f14-be45-448e-9a2a-9e8ae543fa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:50 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Volume ce821f1e-98e2-40c2-9a3f-c9046e6327ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff', 'volume_size': 1}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-4ab8a874-8edc-4250-bee0-f0a46260183d" released by "delete_volume" :: held 1.159s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['42dd7402-5d3f-4497-8acf-3c13120379c9', 'dfd67fda-019d-4374-b0ce-32b14886bbed', '3599a483-3abd-4d78-a311-21b91f3f321f', 'ef7978bc-5cb9-42ee-98ec-e21eb841c159'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:50 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:50 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:50 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c 1G" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:50 devstack sudo[88230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c
Apr 20 23:39:50 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:50 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8348600b-6b9b-4ed5-b3d8-854f983f91fb" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Lock "cinder-quobyte-8348600b-6b9b-4ed5-b3d8-854f983f91fb" released by "delete_volume" :: held 0.996s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Created reservations ['b5820a62-4aef-41e0-84de-bfe4b3bf5e05', '33000f33-efc9-4cc6-89af-cc2d51a70118', 'e133bf34-4cc4-4d80-8fce-ed6ba4939bdf', 'acf05069-444b-4569-b95a-1ab104d2ca44'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:50 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:50 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:50 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Deleted volume successfully.
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-656ae553-5498-4b09-9adf-4e1ee74aa89e tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-4ab8a874-8edc-4250-bee0-f0a46260183d-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:50 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:50 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c is being set with open permissions: ugo+rw
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:50 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c
Apr 20 23:39:50 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:50 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Deleted volume successfully.
Apr 20 23:39:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-70a0a145-41a8-473e-8cdb-f7741cc54d1b tempest-VolumesNegativeTest-1551635320 None] Lock "cinder-8348600b-6b9b-4ed5-b3d8-854f983f91fb-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:51 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1464809685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce821f1e-98e2-40c2-9a3f-c9046e6327ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f403ee71f74704b7b66ae7aa8ab1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:50Z,use_quota=True,user_id='0a702ecaa2a6419092d05e75415fcbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Creating volume ce821f1e-98e2-40c2-9a3f-c9046e6327ff {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:51 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:51 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff 1073741824
Apr 20 23:39:51 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9ef65989-8b04-4104-9fd9-8c7312eccbf6 tempest-SnapshotsActionsTest-190346153 None] Create snapshot completed successfully
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (68824dec-4c6e-4af3-aa43-14045f5b0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19423141-52a4-4928-a8b4-93c48c2114ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19423141-52a4-4928-a8b4-93c48c2114ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-524612326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73e0cc-4a40-4767-84b5-838599e38e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:51Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25539231-f8f6-4429-9a16-06b285ff60da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25539231-f8f6-4429-9a16-06b285ff60da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce7118e-7652-4c1e-9266-88fc20caa75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce7118e-7652-4c1e-9266-88fc20caa75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b73e0cc-4a40-4767-84b5-838599e38e39', 'volume_name': 'volume-8b73e0cc-4a40-4767-84b5-838599e38e39', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b0fa38-1704-47c7-b30a-21044ad47339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b0fa38-1704-47c7-b30a-21044ad47339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3e089d-96a9-438e-bd1b-1f53c13e0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Volume 8b73e0cc-4a40-4767-84b5-838599e38e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b73e0cc-4a40-4767-84b5-838599e38e39', 'volume_size': 1}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:51 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff 1073741824" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:51 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff
Apr 20 23:39:51 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:52 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-524612326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73e0cc-4a40-4767-84b5-838599e38e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:51Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Creating volume 8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:52 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72032f14-be45-448e-9a2a-9e8ae543fa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecf7b7c-f759-484f-a919-fd86f921de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:52 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 1073741824
Apr 20 23:39:52 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Volume volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff (ce821f1e-98e2-40c2-9a3f-c9046e6327ff): created successfully
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecf7b7c-f759-484f-a919-fd86f921de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Flow 'volume_create_manager' (de0a7991-95e9-41a5-8ac1-e998f3648f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d29ada38-77a2-47f5-9f9c-ee425afc3359 tempest-VolumesTransfersTest-492519350 None] Created volume successfully.
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-da1f4af0-e657-4026-b7cf-85cf3a351c8c-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-da1f4af0-e657-4026-b7cf-85cf3a351c8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Acquiring lock "cinder-quobyte-da1f4af0-e657-4026-b7cf-85cf3a351c8c" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-da1f4af0-e657-4026-b7cf-85cf3a351c8c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Deleting offline snapshot da1f4af0-e657-4026-b7cf-85cf3a351c8c of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] snapshot_file for this snap is: volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b845f8-749f-4e31-82ee-f3b5b607786d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:52 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c
Apr 20 23:39:52 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:52 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 1073741824" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:52 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:39:52 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:52 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c" returned: 0 in 0.567s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e79c0b-d573-4433-9192-64ce2ccc8fde]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:53 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:53 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (2e7fdf5b-6997-4a9f-8971-01f5088d9d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd4e4ad-0b7a-41c4-93a7-77e062855f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd4e4ad-0b7a-41c4-93a7-77e062855f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043872355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67354aad-5b02-4a02-84cc-da0c9894b917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:53Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577fdee6-e00a-4f9d-8c78-81e964140c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577fdee6-e00a-4f9d-8c78-81e964140c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd69342-9f80-427d-9510-a5185488dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd69342-9f80-427d-9510-a5185488dff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67354aad-5b02-4a02-84cc-da0c9894b917', 'volume_name': 'volume-67354aad-5b02-4a02-84cc-da0c9894b917', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c71913-698f-4dcb-9028-2feb7abe5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c71913-698f-4dcb-9028-2feb7abe5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f74eea2-b382-45ee-8cec-3464f35a28dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume 67354aad-5b02-4a02-84cc-da0c9894b917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67354aad-5b02-4a02-84cc-da0c9894b917', 'volume_size': 1}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:53 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043872355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67354aad-5b02-4a02-84cc-da0c9894b917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:53Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Creating volume 67354aad-5b02-4a02-84cc-da0c9894b917 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:53 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:53 devstack sudo[88268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917 1073741824
Apr 20 23:39:53 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3e089d-96a9-438e-bd1b-1f53c13e0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b73e0cc-4a40-4767-84b5-838599e38e39', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e45e656-dc61-4c90-83b9-de31deee7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Volume volume-8b73e0cc-4a40-4767-84b5-838599e38e39 (8b73e0cc-4a40-4767-84b5-838599e38e39): created successfully
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e45e656-dc61-4c90-83b9-de31deee7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (68824dec-4c6e-4af3-aa43-14045f5b0b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d4692d04-1f44-4067-bb15-9a4797931e5b tempest-VolumesSnapshotTestJSON-828142989 None] Created volume successfully.
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Acquiring lock "cinder-ce821f1e-98e2-40c2-9a3f-c9046e6327ff-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Lock "cinder-ce821f1e-98e2-40c2-9a3f-c9046e6327ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Acquiring lock "cinder-quobyte-ce821f1e-98e2-40c2-9a3f-c9046e6327ff" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Lock "cinder-quobyte-ce821f1e-98e2-40c2-9a3f-c9046e6327ff" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad306a7-22d6-412e-9e62-dc0b5ad3fd0a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:53 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.553s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:53 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c
Apr 20 23:39:53 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:53 devstack sudo[88273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff
Apr 20 23:39:53 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:53 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917 1073741824" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:53 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917
Apr 20 23:39:53 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:54 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:54 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c
Apr 20 23:39:54 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:54 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:54 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff
Apr 20 23:39:54 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:54 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917" returned: 0 in 0.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f74eea2-b382-45ee-8cec-3464f35a28dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67354aad-5b02-4a02-84cc-da0c9894b917', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61339a31-58d0-432c-a1ae-95767b2f4371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Creating offline snapshot a524503c-1c21-4ade-9fcf-999149dad7a2 of volume 8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:39:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume volume-67354aad-5b02-4a02-84cc-da0c9894b917 (67354aad-5b02-4a02-84cc-da0c9894b917): created successfully
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61339a31-58d0-432c-a1ae-95767b2f4371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (2e7fdf5b-6997-4a9f-8971-01f5088d9d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b2cd62-18e3-474f-af0f-674f1949496a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c4603e2d-5b67-4b7a-9838-83159eb3b5cf tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created volume successfully.
Apr 20 23:39:54 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:39:54 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:54 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ce821f1e-98e2-40c2-9a3f-c9046e6327ff" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Lock "cinder-quobyte-ce821f1e-98e2-40c2-9a3f-c9046e6327ff" released by "delete_volume" :: held 1.024s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:54 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Created reservations ['ef07b6e4-6cc1-485c-9d67-b85bcb2bb6de', '622d4d1b-7602-443b-8c43-689c15ab33cf', '0daa7954-e58b-4c88-8315-7cd90f89033b', '892aa6a8-d7c1-4972-abbc-70cfdccd3360'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.da1f4af0-e657-4026-b7cf-85cf3a351c8c" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-da1f4af0-e657-4026-b7cf-85cf3a351c8c" released by "_delete_snapshot" :: held 2.170s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" released by "delete_snapshot" :: held 2.187s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:54 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Created reservations ['8c7bdaff-4dcb-49aa-9352-91b543daf3c1', '25be0fab-b774-4edb-8f6d-08cf9b75b1f4', 'cef5f7b8-2a1e-4bc7-9305-5b1353071e47', 'bcbff747-2432-43e2-98c5-a6d499a46cba'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:54 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Delete snapshot completed successfully.
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23684b1c-0b4a-48f5-a10a-0a02362cc17b tempest-SnapshotsActionsTest-307976281 None] Lock "cinder-da1f4af0-e657-4026-b7cf-85cf3a351c8c-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:54 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:54 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 1G
Apr 20 23:39:54 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:55 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:39:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Deleted volume successfully.
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91fb4f45-2916-41b8-a041-a30b2b64fc9d tempest-VolumesTransfersTest-302997598 None] Lock "cinder-ce821f1e-98e2-40c2-9a3f-c9046e6327ff-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:55 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 1G" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73e0cc-4a40-4767-84b5-838599e38e39 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:55 devstack sudo[88308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73e0cc-4a40-4767-84b5-838599e38e39 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2
Apr 20 23:39:55 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (4dc89184-0893-412e-ac8d-72ef58f8c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780d937a-aba2-4b4b-9d37-af05ab835e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780d937a-aba2-4b4b-9d37-af05ab835e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1633489627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7c9633-5b35-4c2e-8eb1-7050e6554c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:55Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c9e923-3667-40c1-baa7-00316fc03a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c9e923-3667-40c1-baa7-00316fc03a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20788af-c484-4997-877b-4db793098fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20788af-c484-4997-877b-4db793098fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7c9633-5b35-4c2e-8eb1-7050e6554c53', 'volume_name': 'volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f275877b-fab2-4f60-9e91-83e93dbf8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f275877b-fab2-4f60-9e91-83e93dbf8785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7b959e-1b5e-4282-9d3d-f0dd458597c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume ac7c9633-5b35-4c2e-8eb1-7050e6554c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53', 'volume_size': 1}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (67455585-5a32-49fc-a079-46c09549fe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41223126-cbf8-403d-bf80-ecf05d7a6450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41223126-cbf8-403d-bf80-ecf05d7a6450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864905545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85cc84d-87a3-4b35-98c7-b926176e07cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb44126-6ffe-4baf-aa7a-3c720d6a2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb44126-6ffe-4baf-aa7a-3c720d6a2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafb6998-3642-4854-8a87-1a0ee092a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafb6998-3642-4854-8a87-1a0ee092a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85cc84d-87a3-4b35-98c7-b926176e07cb', 'volume_name': 'volume-d85cc84d-87a3-4b35-98c7-b926176e07cb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1e28b-f832-4047-9e15-1cfb40d52eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1e28b-f832-4047-9e15-1cfb40d52eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b67d4be-c242-4e81-ac60-29e6169ae91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume d85cc84d-87a3-4b35-98c7-b926176e07cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85cc84d-87a3-4b35-98c7-b926176e07cb', 'volume_size': 1}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:55 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73e0cc-4a40-4767-84b5-838599e38e39 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:55 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 is being set with open permissions: ugo+rw
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:55 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2
Apr 20 23:39:55 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "cinder-2b33e900-8c16-4c7a-88fa-1e9a5c053011-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-2b33e900-8c16-4c7a-88fa-1e9a5c053011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "cinder-quobyte-2b33e900-8c16-4c7a-88fa-1e9a5c053011" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-quobyte-2b33e900-8c16-4c7a-88fa-1e9a5c053011" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Deleting offline snapshot 2b33e900-8c16-4c7a-88fa-1e9a5c053011 of volume 02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:39:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] snapshot_file for this snap is: volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b51ea6d-b787-4b7c-8575-4ff43eb50164]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (ebd0cd4a-0f93-4211-8432-9f68c50a866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d71196f-fa81-4f52-bac2-159aada2c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:56 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d71196f-fa81-4f52-bac2-159aada2c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826084875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02ce614-4c21-4136-bbad-02c5014fc680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91c4855-5415-4508-9546-f512c16d876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91c4855-5415-4508-9546-f512c16d876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1004ae-309f-4608-a008-a8202712b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1004ae-309f-4608-a008-a8202712b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02ce614-4c21-4136-bbad-02c5014fc680', 'volume_name': 'volume-b02ce614-4c21-4136-bbad-02c5014fc680', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60ade03-595c-447e-a99c-da04b0a489a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60ade03-595c-447e-a99c-da04b0a489a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c3d5d6-5b79-4c2e-8069-b6eb1027cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume b02ce614-4c21-4136-bbad-02c5014fc680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02ce614-4c21-4136-bbad-02c5014fc680', 'volume_size': 1}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (eb8d6378-9837-4c07-814b-c108f0c685fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2041405-6e0f-4082-820e-107f66218cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2041405-6e0f-4082-820e-107f66218cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1389325643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244ac7ae-66a8-4375-b203-4f78ecd8489d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee3ee0e-ef89-4f87-943b-e1e1707e04e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee3ee0e-ef89-4f87-943b-e1e1707e04e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3170db45-8d3c-4f05-b34b-b5fa5b63b303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3170db45-8d3c-4f05-b34b-b5fa5b63b303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244ac7ae-66a8-4375-b203-4f78ecd8489d', 'volume_name': 'volume-244ac7ae-66a8-4375-b203-4f78ecd8489d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308d4256-816c-4e2e-a7b6-d62c884def1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308d4256-816c-4e2e-a7b6-d62c884def1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c570ed4a-d010-41ee-8062-527265067258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume 244ac7ae-66a8-4375-b203-4f78ecd8489d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244ac7ae-66a8-4375-b203-4f78ecd8489d', 'volume_size': 1}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (2d1ba971-1881-4d2c-a139-33612f220a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eb8c81-2ec1-4483-92cc-ea64a6f450c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eb8c81-2ec1-4483-92cc-ea64a6f450c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62300158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f052fcb6-1bd9-4df6-9632-34050b892e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3576d497-d5aa-469d-bde6-42be01061702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3576d497-d5aa-469d-bde6-42be01061702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebe8377-ca0f-43bb-ade7-d3519bd3cd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebe8377-ca0f-43bb-ade7-d3519bd3cd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f052fcb6-1bd9-4df6-9632-34050b892e18', 'volume_name': 'volume-f052fcb6-1bd9-4df6-9632-34050b892e18', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa4bd97-4ff0-4df0-8a19-c388081c1765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa4bd97-4ff0-4df0-8a19-c388081c1765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa61f15-4879-4e09-be51-706501329135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:56 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume f052fcb6-1bd9-4df6-9632-34050b892e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f052fcb6-1bd9-4df6-9632-34050b892e18', 'volume_size': 1}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2" returned: 0 in 0.634s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:56 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info
Apr 20 23:39:56 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:56 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.633s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02da4adf-0033-49a9-aa49-1921d3ace3a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[17607c52-de41-4879-983c-91cb2dfca5bb]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:56 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6
Apr 20 23:39:56 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:56 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:56 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info is being set with open permissions: ugo+rw
Apr 20 23:39:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:57 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info
Apr 20 23:39:57 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:57 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:57 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:57 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:57 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.info" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1633489627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7c9633-5b35-4c2e-8eb1-7050e6554c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:55Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Creating volume ac7c9633-5b35-4c2e-8eb1-7050e6554c53 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:57 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:57 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 1073741824
Apr 20 23:39:57 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-17f6b438-b856-42a8-8e98-10928dcf7ab1 tempest-VolumesSnapshotTestJSON-828142989 None] Create snapshot completed successfully
Apr 20 23:39:57 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:57 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011
Apr 20 23:39:57 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:58 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 1073741824" returned: 0 in 0.652s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (4e802d7d-3383-4e93-8066-2b2685ca4022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d75bc1-dd85-4034-9fe1-9605eca9f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d75bc1-dd85-4034-9fe1-9605eca9f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509148487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e6b847-3de7-45f1-abf8-a833bdded062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17e320787e594e25b5f96bb7bdbf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a524503c-1c21-4ade-9fcf-999149dad7a2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:58Z,use_quota=True,user_id='86edc092cea547ad8f8fb320e8ef78b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0097f46f-2999-42db-8507-22e0a9045963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0097f46f-2999-42db-8507-22e0a9045963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302d9342-5b08-43e0-a65d-506f9f80392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302d9342-5b08-43e0-a65d-506f9f80392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58e6b847-3de7-45f1-abf8-a833bdded062', 'volume_name': 'volume-58e6b847-3de7-45f1-abf8-a833bdded062', 'volume_size': 1, 'snapshot_id': 'a524503c-1c21-4ade-9fcf-999149dad7a2'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e77d5a-1045-43bf-81bc-9a4bfdf19f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e77d5a-1045-43bf-81bc-9a4bfdf19f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4b989a-1345-450f-a9ef-1ca66f91e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Volume 58e6b847-3de7-45f1-abf8-a833bdded062: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58e6b847-3de7-45f1-abf8-a833bdded062', 'volume_size': 1, 'snapshot_id': 'a524503c-1c21-4ade-9fcf-999149dad7a2'}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:58 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6.2b33e900-8c16-4c7a-88fa-1e9a5c053011" returned: 0 in 0.558s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:58 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53
Apr 20 23:39:58 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-quobyte-2b33e900-8c16-4c7a-88fa-1e9a5c053011" released by "_delete_snapshot" :: held 2.344s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" released by "delete_snapshot" :: held 2.363s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Created reservations ['bea4c77b-d27a-42dd-94b2-28749959544c', 'b1ace9cd-9563-485c-9c46-a073af7b2ab4', '3b9b1e01-799e-44e6-9ea1-a8355e70c8a2', '2a93b6b1-6cb7-4e5b-8940-3708bea689eb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:39:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Delete snapshot completed successfully.
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2634c0a1-494a-4b62-bcfc-a950b757053e tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-2b33e900-8c16-4c7a-88fa-1e9a5c053011-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:39:58 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.933s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864905545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85cc84d-87a3-4b35-98c7-b926176e07cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Creating volume d85cc84d-87a3-4b35-98c7-b926176e07cb {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:58 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7b959e-1b5e-4282-9d3d-f0dd458597c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36ca1f-65d9-4bb6-a840-8a0cb7a9759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:58 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb 1073741824
Apr 20 23:39:58 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 (ac7c9633-5b35-4c2e-8eb1-7050e6554c53): created successfully
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36ca1f-65d9-4bb6-a840-8a0cb7a9759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (4dc89184-0893-412e-ac8d-72ef58f8c02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e709d9ca-a94c-43a6-a711-30d94913054a tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created volume successfully.
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "cinder-02da4adf-0033-49a9-aa49-1921d3ace3a6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-02da4adf-0033-49a9-aa49-1921d3ace3a6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[89657b55-bc4e-4f89-9baa-67f5ff55f82d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:59 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb 1073741824" returned: 0 in 0.580s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:59 devstack sudo[88354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6
Apr 20 23:39:59 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:59 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb
Apr 20 23:39:59 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:59 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.700s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826084875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02ce614-4c21-4136-bbad-02c5014fc680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Creating volume b02ce614-4c21-4136-bbad-02c5014fc680 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:39:59 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:59 devstack sudo[88362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680 1073741824
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b67d4be-c242-4e81-ac60-29e6169ae91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85cc84d-87a3-4b35-98c7-b926176e07cb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:59 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973175b-337c-4ef2-9b78-84ed96744aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:39:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume volume-d85cc84d-87a3-4b35-98c7-b926176e07cb (d85cc84d-87a3-4b35-98c7-b926176e07cb): created successfully
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a973175b-337c-4ef2-9b78-84ed96744aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:39:59 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (67455585-5a32-49fc-a079-46c09549fe90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6" returned: 0 in 0.568s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:39:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:39:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-320b6080-c78f-4d3c-9a10-0c7caaba3317 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created volume successfully.
Apr 20 23:39:59 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6
Apr 20 23:39:59 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Flow 'volume_create_manager' (7e6ca080-ecd3-4485-a5f3-a6c98a9e89b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d08cef-1174-437b-bfb6-48b9f7e2099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d08cef-1174-437b-bfb6-48b9f7e2099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1636410901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa774e5-0126-41ab-aed5-1f29fdb8d184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a12a762a84cd0b6d8e42dc8d9bc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:00Z,use_quota=True,user_id='3210ef09a4d044a8bbbb68d4b663eb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592f09f5-ed5d-47a8-b4d2-9d181261266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592f09f5-ed5d-47a8-b4d2-9d181261266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a1d5db-2605-422c-a03c-e6a9a8ae1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a1d5db-2605-422c-a03c-e6a9a8ae1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa774e5-0126-41ab-aed5-1f29fdb8d184', 'volume_name': 'volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d698e67-dd97-4ae4-b9c9-ae7d036ec97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d698e67-dd97-4ae4-b9c9-ae7d036ec97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7f5f0d-448a-4695-be6b-73667769fcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Volume 8fa774e5-0126-41ab-aed5-1f29fdb8d184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184', 'volume_size': 1}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:00 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-02da4adf-0033-49a9-aa49-1921d3ace3a6" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:00 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680 1073741824" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-quobyte-02da4adf-0033-49a9-aa49-1921d3ace3a6" released by "delete_volume" :: held 1.072s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:00 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680
Apr 20 23:40:00 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Created reservations ['a96b7bc2-5a76-430a-a51c-d90ba34346b4', '82c4de9f-bf1d-4660-bcf9-2953da6db4c7', 'ff0609b3-61f3-499c-836b-8a98f8705596', '75ac0665-11b2-44d3-823a-079c62044a29'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:00 devstack sudo[88372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:00 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:00 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.492s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1389325643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244ac7ae-66a8-4375-b203-4f78ecd8489d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Creating volume 244ac7ae-66a8-4375-b203-4f78ecd8489d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:00 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c3d5d6-5b79-4c2e-8069-b6eb1027cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02ce614-4c21-4136-bbad-02c5014fc680', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:00 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:00 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d 1073741824
Apr 20 23:40:00 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7dc146-e7ca-4a88-a112-f9f4a977332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Deleted volume successfully.
Apr 20 23:40:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume volume-b02ce614-4c21-4136-bbad-02c5014fc680 (b02ce614-4c21-4136-bbad-02c5014fc680): created successfully
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7dc146-e7ca-4a88-a112-f9f4a977332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (ebd0cd4a-0f93-4211-8432-9f68c50a866d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e541a789-c076-4a42-9ccc-f0c557756d58 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created volume successfully.
Apr 20 23:40:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-aa12ac22-3bd3-44ff-bf69-9b4bdedd2a6a tempest-SnapshotsActionsTest-190346153 None] Lock "cinder-02da4adf-0033-49a9-aa49-1921d3ace3a6-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:01 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d 1073741824" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:01 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d
Apr 20 23:40:01 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:01 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.277s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62300158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f052fcb6-1bd9-4df6-9632-34050b892e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535d1b6cab841e2a213f29b8c8b34ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:39:56Z,use_quota=True,user_id='6062e376c508439eae5fcadaeecb5ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Creating volume f052fcb6-1bd9-4df6-9632-34050b892e18 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:01 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18 1073741824
Apr 20 23:40:01 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c570ed4a-d010-41ee-8062-527265067258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244ac7ae-66a8-4375-b203-4f78ecd8489d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9d6e74-96e0-4c2d-aa8f-ffad451274b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume volume-244ac7ae-66a8-4375-b203-4f78ecd8489d (244ac7ae-66a8-4375-b203-4f78ecd8489d): created successfully
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9d6e74-96e0-4c2d-aa8f-ffad451274b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (eb8d6378-9837-4c07-814b-c108f0c685fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2c8f7f93-f092-4c47-b069-1a2d01c7fa48 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created volume successfully.
Apr 20 23:40:02 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18 1073741824" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:02 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18
Apr 20 23:40:02 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:02 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.624s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-a524503c-1c21-4ade-9fcf-999149dad7a2-58e6b847-3de7-45f1-abf8-a833bdded062" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa61f15-4879-4e09-be51-706501329135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f052fcb6-1bd9-4df6-9632-34050b892e18', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf8279a-38bd-4f0b-b4a8-1cfddc545e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-a524503c-1c21-4ade-9fcf-999149dad7a2-58e6b847-3de7-45f1-abf8-a833bdded062" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Creating volume 58e6b847-3de7-45f1-abf8-a833bdded062 from snapshot a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-58e6b847-3de7-45f1-abf8-a833bdded062" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Volume volume-f052fcb6-1bd9-4df6-9632-34050b892e18 (f052fcb6-1bd9-4df6-9632-34050b892e18): created successfully
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf8279a-38bd-4f0b-b4a8-1cfddc545e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Flow 'volume_create_manager' (2d1ba971-1881-4d2c-a139-33612f220a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b56c3de6-905d-4aa7-b428-0404debee6dc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created volume successfully.
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-58e6b847-3de7-45f1-abf8-a833bdded062" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] snapshot: a524503c-1c21-4ade-9fcf-999149dad7a2, volume: 58e6b847-3de7-45f1-abf8-a833bdded062,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d34641-1f38-4879-86eb-7b0b8e25bce9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:03 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2
Apr 20 23:40:03 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:03 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73e0cc-4a40-4767-84b5-838599e38e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:40:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:40:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d3b50b-46e8-407c-a995-bd7f4ff5d558]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:03 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:40:03 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-f052fcb6-1bd9-4df6-9632-34050b892e18-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-f052fcb6-1bd9-4df6-9632-34050b892e18-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:04 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.523s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-quobyte-f052fcb6-1bd9-4df6-9632-34050b892e18" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:04 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062
Apr 20 23:40:04 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-f052fcb6-1bd9-4df6-9632-34050b892e18" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf4b8dc-7b95-487d-a116-2641c0d13bc8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:04 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18
Apr 20 23:40:04 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:04 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18" returned: 0 in 0.750s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:04 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18
Apr 20 23:40:04 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:06 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f052fcb6-1bd9-4df6-9632-34050b892e18" returned: 0 in 1.320s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:06 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062" returned: 0 in 2.120s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-f052fcb6-1bd9-4df6-9632-34050b892e18" released by "delete_volume" :: held 2.092s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4821f5-6538-495f-9fef-81181ba8b6e7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created reservations ['ee59e168-73a6-4f63-bfd0-8e1a08ba3836', 'e3bb9097-e507-4352-af00-d2c5f656fac9', '69397cc1-c377-4fa2-9228-bc554e750ace', '7dda3f38-364b-4187-987e-a8652d21113c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:06 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:40:06 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:06 devstack sudo[88424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:06 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:06 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Deleted volume successfully.
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-897fdecc-3367-47d6-bfb3-1880f7a28ccc tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-f052fcb6-1bd9-4df6-9632-34050b892e18-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:06 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.665s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:40:06 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Converted 1024.00 MB image at 482.81 MB/s
Apr 20 23:40:06 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 is being set with open permissions: ugo+rw
Apr 20 23:40:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:06 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062
Apr 20 23:40:06 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:07 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-244ac7ae-66a8-4375-b203-4f78ecd8489d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-58e6b847-3de7-45f1-abf8-a833bdded062" released by "_copy_volume_from_snapshot" :: held 4.360s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-244ac7ae-66a8-4375-b203-4f78ecd8489d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-a524503c-1c21-4ade-9fcf-999149dad7a2-58e6b847-3de7-45f1-abf8-a833bdded062" released by "_create_volume_from_snapshot" :: held 4.400s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.423s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.127s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1636410901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa774e5-0126-41ab-aed5-1f29fdb8d184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a12a762a84cd0b6d8e42dc8d9bc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:00Z,use_quota=True,user_id='3210ef09a4d044a8bbbb68d4b663eb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Creating volume 8fa774e5-0126-41ab-aed5-1f29fdb8d184 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:07 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:07 devstack sudo[88434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 1073741824
Apr 20 23:40:07 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4b989a-1345-450f-a9ef-1ca66f91e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e6b847-3de7-45f1-abf8-a833bdded062', 'volume_size': 1, 'snapshot_id': 'a524503c-1c21-4ade-9fcf-999149dad7a2'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b914a41f-37ae-46f0-a7ac-b140a7f0796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Volume volume-58e6b847-3de7-45f1-abf8-a833bdded062 (58e6b847-3de7-45f1-abf8-a833bdded062): created successfully
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b914a41f-37ae-46f0-a7ac-b140a7f0796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Flow 'volume_create_manager' (4e802d7d-3383-4e93-8066-2b2685ca4022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-quobyte-244ac7ae-66a8-4375-b203-4f78ecd8489d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4f300e72-c75c-44f9-96d9-821bb8ee1454 tempest-VolumesSnapshotTestJSON-828142989 None] Created volume successfully.
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-244ac7ae-66a8-4375-b203-4f78ecd8489d" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac3197d-7f1b-417b-9f06-29ae9238c38f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:07 devstack sudo[88436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d
Apr 20 23:40:07 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-58e6b847-3de7-45f1-abf8-a833bdded062-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-58e6b847-3de7-45f1-abf8-a833bdded062-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-58e6b847-3de7-45f1-abf8-a833bdded062" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-58e6b847-3de7-45f1-abf8-a833bdded062" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb58130-2671-494f-9fe4-7d175976b6f3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:07 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062
Apr 20 23:40:07 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:07 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 1073741824" returned: 0 in 0.563s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:07 devstack sudo[88447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184
Apr 20 23:40:07 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:08 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d" returned: 0 in 0.615s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:08 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d
Apr 20 23:40:08 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:08 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:08 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062
Apr 20 23:40:08 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:08 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7f5f0d-448a-4695-be6b-73667769fcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6d467d-f47b-4922-9d7c-230414773294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Volume volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 (8fa774e5-0126-41ab-aed5-1f29fdb8d184): created successfully
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6d467d-f47b-4922-9d7c-230414773294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Flow 'volume_create_manager' (7e6ca080-ecd3-4485-a5f3-a6c98a9e89b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b89f0dab-ee6c-4af9-9458-82e788f82ec6 tempest-VolumesTransfersV355Test-1018564862 None] Created volume successfully.
Apr 20 23:40:08 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-244ac7ae-66a8-4375-b203-4f78ecd8489d" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-244ac7ae-66a8-4375-b203-4f78ecd8489d" released by "delete_volume" :: held 1.114s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created reservations ['e46830bf-0533-473c-856a-086b04781d71', '949d7c8f-848e-4ec4-acf3-c4315456cb5a', '9d24f3cd-eee1-40ca-9cc5-1386917aaf78', 'c43d9481-4bbc-42b4-b241-40dadb4a98b4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:08 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:08 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:08 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-58e6b847-3de7-45f1-abf8-a833bdded062" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-58e6b847-3de7-45f1-abf8-a833bdded062" released by "delete_volume" :: held 1.063s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['5d5ab52f-6d90-4e46-91d5-096c6895de71', 'a7ea23a8-4b5a-4072-a50d-a169cf5ee4ab', 'd38e103a-c5aa-432f-abf1-ffd1a7e0d1dc', '4ebaa444-ffab-43c4-9e51-b90597b6d031'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:08 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:08 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2a717cbf-25b3-48b0-ac9f-6dd8c0cf89a6 tempest-VolumesTransfersV355Test-1190054088 None] Transfer volume completed successfully.
Apr 20 23:40:09 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.635s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Deleted volume successfully.
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8920a290-d1df-42cc-a68c-557c8657ef10 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-244ac7ae-66a8-4375-b203-4f78ecd8489d-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:09 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Deleted volume successfully.
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2cf9d486-8d8d-450a-a633-41d230b17a32 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-58e6b847-3de7-45f1-abf8-a833bdded062-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-b02ce614-4c21-4136-bbad-02c5014fc680-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-b02ce614-4c21-4136-bbad-02c5014fc680-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-quobyte-b02ce614-4c21-4136-bbad-02c5014fc680" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-b02ce614-4c21-4136-bbad-02c5014fc680" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0937a07-c5fa-46bf-b7f7-7e5d9b768db9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:09 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680
Apr 20 23:40:09 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-a524503c-1c21-4ade-9fcf-999149dad7a2-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-a524503c-1c21-4ade-9fcf-999149dad7a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-8b73e0cc-4a40-4767-84b5-838599e38e39" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8b73e0cc-4a40-4767-84b5-838599e38e39" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-a524503c-1c21-4ade-9fcf-999149dad7a2" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-a524503c-1c21-4ade-9fcf-999149dad7a2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Deleting offline snapshot a524503c-1c21-4ade-9fcf-999149dad7a2 of volume 8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] snapshot_file for this snap is: volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875e7c6-5751-482d-a5c9-0c31b39e2b4a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:10 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680" returned: 0 in 0.561s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:10 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2
Apr 20 23:40:10 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:10 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680
Apr 20 23:40:10 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Acquiring lock "cinder-8fa774e5-0126-41ab-aed5-1f29fdb8d184-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-8fa774e5-0126-41ab-aed5-1f29fdb8d184-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Acquiring lock "cinder-quobyte-8fa774e5-0126-41ab-aed5-1f29fdb8d184" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-quobyte-8fa774e5-0126-41ab-aed5-1f29fdb8d184" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a086b-c38f-44a2-95fa-4d8a83bec162]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:10 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184
Apr 20 23:40:10 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:10 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b02ce614-4c21-4136-bbad-02c5014fc680" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-b02ce614-4c21-4136-bbad-02c5014fc680" released by "delete_volume" :: held 1.075s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:10 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73e0cc-4a40-4767-84b5-838599e38e39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a3ee90-6ae3-4f43-8262-a0161e0922ac]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created reservations ['142cd132-b89c-4248-a8ff-3dff15394722', 'a1f89482-f61c-4706-9b5f-1cf0127e0064', '312df7f3-0a26-4bd9-a197-93334a193782', '2f470333-2e0f-49d8-b58f-9ffc17054ade'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:10 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:40:10 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:10 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:10 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:10 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184" returned: 0 in 0.621s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:10 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184
Apr 20 23:40:10 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:11 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.523s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:11 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.619s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Deleted volume successfully.
Apr 20 23:40:11 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2
Apr 20 23:40:11 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-085d9fb2-759b-4000-9636-4e36cd4458ac tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-b02ce614-4c21-4136-bbad-02c5014fc680-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:11 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8fa774e5-0126-41ab-aed5-1f29fdb8d184" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-quobyte-8fa774e5-0126-41ab-aed5-1f29fdb8d184" released by "delete_volume" :: held 1.170s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Created reservations ['b9c099e2-5889-463b-bbdb-d7f507e0c03b', 'c66cf8a5-a4d2-4c34-9b6e-2fa34d189738', 'bc7d8b63-d1ef-42f6-a301-8b99953abe67', 'ba531593-4f5e-4506-a016-875b12c4c367'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:11 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:11 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-d85cc84d-87a3-4b35-98c7-b926176e07cb-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-d85cc84d-87a3-4b35-98c7-b926176e07cb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-quobyte-d85cc84d-87a3-4b35-98c7-b926176e07cb" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-d85cc84d-87a3-4b35-98c7-b926176e07cb" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b526b-ac0b-4510-9008-0273bae612ff]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:11 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb
Apr 20 23:40:11 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:11 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2" returned: 0 in 0.630s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:11 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2
Apr 20 23:40:11 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:11 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Deleted volume successfully.
Apr 20 23:40:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f1566b6a-8028-4898-8e37-418c57347305 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-8fa774e5-0126-41ab-aed5-1f29fdb8d184-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:12 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb" returned: 0 in 0.545s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:12 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb
Apr 20 23:40:12 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:12 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39.a524503c-1c21-4ade-9fcf-999149dad7a2" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-a524503c-1c21-4ade-9fcf-999149dad7a2" released by "_delete_snapshot" :: held 2.423s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8b73e0cc-4a40-4767-84b5-838599e38e39" released by "delete_snapshot" :: held 2.437s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['2e931f81-65ba-4f6e-b4e1-bf3ebcb11dc7', '5384bdd1-807a-4ac2-94ad-17453a28ddab', '2e3d2595-6bd0-444e-acc1-4001eff4d2e8', 'c21a1464-473c-46c9-9e8e-1f59595a760e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Delete snapshot completed successfully.
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da1f14f0-384b-435e-bf5c-e07d59e4faad tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-a524503c-1c21-4ade-9fcf-999149dad7a2-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Flow 'volume_create_manager' (7d6cf140-1267-40c6-96e8-0af0a802e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1946924c-5f5d-4710-9dfd-ec1c71b8842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1946924c-5f5d-4710-9dfd-ec1c71b8842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-636254848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2ded0f-5299-4095-a7f3-2c0acf8e42ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a12a762a84cd0b6d8e42dc8d9bc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:13Z,use_quota=True,user_id='3210ef09a4d044a8bbbb68d4b663eb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22b5ace-9755-41cd-ae35-43193a659729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22b5ace-9755-41cd-ae35-43193a659729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b584cb30-6b4c-4317-9a39-ecaeef7f9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b584cb30-6b4c-4317-9a39-ecaeef7f9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2ded0f-5299-4095-a7f3-2c0acf8e42ea', 'volume_name': 'volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64365188-5ca0-4608-a65f-9c48f13463e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64365188-5ca0-4608-a65f-9c48f13463e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b985b9a3-4cdd-4669-8dfd-805f894a6ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Volume dd2ded0f-5299-4095-a7f3-2c0acf8e42ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea', 'volume_size': 1}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-636254848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2ded0f-5299-4095-a7f3-2c0acf8e42ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648a12a762a84cd0b6d8e42dc8d9bc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:13Z,use_quota=True,user_id='3210ef09a4d044a8bbbb68d4b663eb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Creating volume dd2ded0f-5299-4095-a7f3-2c0acf8e42ea {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:12 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea 1073741824
Apr 20 23:40:12 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:12 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d85cc84d-87a3-4b35-98c7-b926176e07cb" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-d85cc84d-87a3-4b35-98c7-b926176e07cb" released by "delete_volume" :: held 1.124s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created reservations ['ae3fe48b-125b-4aa5-ab34-b303611e3706', '609da0ff-bba4-49f3-b0ce-d20eb6c5a889', '3d0cc097-69f4-4195-b686-3c90fb6df712', 'c39d6ea0-3c29-48d2-90b1-82544575d022'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:12 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:12 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-8b73e0cc-4a40-4767-84b5-838599e38e39-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-8b73e0cc-4a40-4767-84b5-838599e38e39-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-8b73e0cc-4a40-4767-84b5-838599e38e39" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8b73e0cc-4a40-4767-84b5-838599e38e39" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43662471-6733-4b33-8d65-1219a79417ce]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:13 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:40:13 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:13 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea 1073741824" returned: 0 in 0.600s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:13 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea
Apr 20 23:40:13 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:13 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Deleted volume successfully.
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-825187dd-6ae4-4b1e-a36e-f5e7117ca696 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-d85cc84d-87a3-4b35-98c7-b926176e07cb-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:13 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:13 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39
Apr 20 23:40:13 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-ac7c9633-5b35-4c2e-8eb1-7050e6554c53-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-ac7c9633-5b35-4c2e-8eb1-7050e6554c53-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:13 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b985b9a3-4cdd-4669-8dfd-805f894a6ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ae21a6-64e4-4ff0-9e60-8aee09ca8413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-quobyte-ac7c9633-5b35-4c2e-8eb1-7050e6554c53" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Volume volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea (dd2ded0f-5299-4095-a7f3-2c0acf8e42ea): created successfully
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ae21a6-64e4-4ff0-9e60-8aee09ca8413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Flow 'volume_create_manager' (7d6cf140-1267-40c6-96e8-0af0a802e084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-ac7c9633-5b35-4c2e-8eb1-7050e6554c53" acquired by "delete_volume" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8f372587-4497-4629-a999-a12139ebdec8 tempest-VolumesTransfersV355Test-1018564862 None] Created volume successfully.
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e02533-278c-400d-a2dc-91ce38ab57f9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:14 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53
Apr 20 23:40:14 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:14 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-8b73e0cc-4a40-4767-84b5-838599e38e39" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-8b73e0cc-4a40-4767-84b5-838599e38e39" released by "delete_volume" :: held 1.067s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['fc2edb87-039d-4ce5-a51c-b5886c648715', '8f8c6332-a431-47a6-ba79-8d6e1b7bd5e6', '2b177d9d-ebdb-45ef-ae95-4f4ce8182f6f', '262cac53-a874-4657-888b-6615cc727442'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:14 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:14 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:14 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:14 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53
Apr 20 23:40:14 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:14 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Deleted volume successfully.
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2db199cd-9d75-4856-9f9b-893a43cbe4e8 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-8b73e0cc-4a40-4767-84b5-838599e38e39-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:14 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ac7c9633-5b35-4c2e-8eb1-7050e6554c53" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-ac7c9633-5b35-4c2e-8eb1-7050e6554c53" released by "delete_volume" :: held 0.990s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:14 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created reservations ['c4387eea-6bbd-42df-a879-d384311de181', '5479bb7f-7aaf-42ea-b4cf-71c710415d5f', '7152b770-e1e2-4ba8-a161-2cbf3f168a5c', '6be6dd8b-021d-478b-a3f3-9165f1069b81'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:15 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:15 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Acquiring lock "cinder-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Acquiring lock "cinder-quobyte-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-quobyte-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[091bc50f-deff-4222-a1ee-febd5d1b17e4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:15 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea
Apr 20 23:40:15 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-ab78111a-bfdc-4244-98f4-352342c68781-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-ab78111a-bfdc-4244-98f4-352342c68781-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "cinder-quobyte-ab78111a-bfdc-4244-98f4-352342c68781" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-ab78111a-bfdc-4244-98f4-352342c68781" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e93d4bf-5862-4cbe-9772-d4a5d9aae4f7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:15 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Deleted volume successfully.
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-815e5d8a-cab6-40d5-8a77-40153ff97368 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-ac7c9633-5b35-4c2e-8eb1-7050e6554c53-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:15 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781
Apr 20 23:40:15 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:15 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea" returned: 0 in 0.550s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:15 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea
Apr 20 23:40:15 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Flow 'volume_create_manager' (c4fe2d63-4063-4d4f-ae92-88e7bdb5a4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7060513a-aeba-48fb-a0de-356cb38f7130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:15 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:15 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7060513a-aeba-48fb-a0de-356cb38f7130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-857279701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f701b073-ed76-4dfb-b1ee-321e31b448e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e183d7a10d548dcb29801b54c96c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:16Z,use_quota=True,user_id='6794b951b77c4f72ac3a20427ba1ba6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56888c84-6ebb-4aac-8cf0-fdf885ba8fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56888c84-6ebb-4aac-8cf0-fdf885ba8fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97be6795-3aed-4309-8f67-d1f1622cbcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97be6795-3aed-4309-8f67-d1f1622cbcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f701b073-ed76-4dfb-b1ee-321e31b448e9', 'volume_name': 'volume-f701b073-ed76-4dfb-b1ee-321e31b448e9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d13e4f2-3cb1-4e01-921f-c370342f9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d13e4f2-3cb1-4e01-921f-c370342f9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfb4747-613f-4d4b-9b14-0749bee3dccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Volume f701b073-ed76-4dfb-b1ee-321e31b448e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f701b073-ed76-4dfb-b1ee-321e31b448e9', 'volume_size': 1}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-857279701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f701b073-ed76-4dfb-b1ee-321e31b448e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e183d7a10d548dcb29801b54c96c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:16Z,use_quota=True,user_id='6794b951b77c4f72ac3a20427ba1ba6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Creating volume f701b073-ed76-4dfb-b1ee-321e31b448e9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:15 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:15 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 1073741824
Apr 20 23:40:15 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:16 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781" returned: 0 in 0.568s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-67354aad-5b02-4a02-84cc-da0c9894b917-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:16 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781
Apr 20 23:40:16 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-67354aad-5b02-4a02-84cc-da0c9894b917-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "cinder-quobyte-67354aad-5b02-4a02-84cc-da0c9894b917" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-67354aad-5b02-4a02-84cc-da0c9894b917" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[655cd91b-075b-44f6-855d-6c2add5259ab]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:16 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea" returned: 0 in 0.594s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-quobyte-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea" released by "delete_volume" :: held 1.164s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:16 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917
Apr 20 23:40:16 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Created reservations ['101ab66e-df90-4713-be51-c4127aeed746', 'bc144d65-fa0c-40da-be75-2c67748742ee', 'a1cabb83-c9c9-4c40-ae81-819e7f175afb', '2bd25161-2d99-4502-974d-33e18ce8d1f6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:16 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:16 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:16 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:16 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ab78111a-bfdc-4244-98f4-352342c68781" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 1073741824" returned: 0 in 0.665s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-quobyte-ab78111a-bfdc-4244-98f4-352342c68781" released by "delete_volume" :: held 1.107s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:16 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9
Apr 20 23:40:16 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Created reservations ['8e600d67-6542-4e55-8272-15b3e9e35764', '81d5cc36-12e9-407e-8e66-65f522222159', 'cbfa3a6e-c4ce-4961-ae4a-9526210115cb', '9a3e403c-c6bf-4104-b7c2-1d0c5979b563'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:16 devstack sudo[88577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:16 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:16 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:16 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Deleted volume successfully.
Apr 20 23:40:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-00fe24da-dc6c-47f0-9f14-90181fe40033 tempest-VolumesTransfersV355Test-2066176319 None] Lock "cinder-dd2ded0f-5299-4095-a7f3-2c0acf8e42ea-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:16 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917
Apr 20 23:40:16 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:17 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfb4747-613f-4d4b-9b14-0749bee3dccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f701b073-ed76-4dfb-b1ee-321e31b448e9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d7a867-7e30-4682-b611-3f3ff89df4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Volume volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 (f701b073-ed76-4dfb-b1ee-321e31b448e9): created successfully
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d7a867-7e30-4682-b611-3f3ff89df4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Flow 'volume_create_manager' (c4fe2d63-4063-4d4f-ae92-88e7bdb5a4a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b2eeb76e-369f-442a-9a49-35a1934bff49 tempest-VolumeQuotasAdminTestJSON-13159138 None] Created volume successfully.
Apr 20 23:40:17 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Deleted volume successfully.
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-06919464-d625-4f4c-ade4-22f749052dd3 tempest-VolumesSnapshotTestJSON-828142989 None] Lock "cinder-ab78111a-bfdc-4244-98f4-352342c68781-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:17 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67354aad-5b02-4a02-84cc-da0c9894b917" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-quobyte-67354aad-5b02-4a02-84cc-da0c9894b917" released by "delete_volume" :: held 1.114s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Created reservations ['dce0cc3b-f0c3-4b16-b837-5d4fbb8721a3', '5331ae4f-b93e-4837-9850-4eae906e524a', '8ad92da3-aa11-465a-aaa5-0ec24a0ea235', '4bc4e2d5-5ab3-40ad-a6da-5492db889f85'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:17 devstack sudo[88588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:17 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:17 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Deleted volume successfully.
Apr 20 23:40:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ce091bc-5c77-4962-b027-7f07d4d6ded3 tempest-CreateVolumesFromSourceVolumeTest-608531240 None] Lock "cinder-67354aad-5b02-4a02-84cc-da0c9894b917-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "cinder-f701b073-ed76-4dfb-b1ee-321e31b448e9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "cinder-f701b073-ed76-4dfb-b1ee-321e31b448e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "cinder-quobyte-f701b073-ed76-4dfb-b1ee-321e31b448e9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "cinder-quobyte-f701b073-ed76-4dfb-b1ee-321e31b448e9" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3543bf2e-650f-48ac-9f71-df580bec1289]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:18 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9
Apr 20 23:40:18 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:18 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9" returned: 0 in 0.587s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:18 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9
Apr 20 23:40:18 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:19 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f701b073-ed76-4dfb-b1ee-321e31b448e9" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "cinder-quobyte-f701b073-ed76-4dfb-b1ee-321e31b448e9" released by "delete_volume" :: held 1.101s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Created reservations ['7da07134-ca6f-4fdf-ae0c-ff554f993ec5', '6333f8cf-2097-46f8-9835-3d035570a362', 'a9c47d72-397c-4b5b-bfb1-b9d77c9c3006', '0b799cf3-49cb-4033-bc38-2041dceace06'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:19 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:19 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:19 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Deleted volume successfully.
Apr 20 23:40:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fc484b16-e354-401b-af79-a86bf132b5bf tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "cinder-f701b073-ed76-4dfb-b1ee-321e31b448e9-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Flow 'volume_create_manager' (3e7ffa07-58e8-48f6-a287-851af8fa35b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5018258-6e76-4892-9e60-e96b7f14285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5018258-6e76-4892-9e60-e96b7f14285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-288752638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fbb281-7de3-4a5e-ac47-8eaddae40980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e183d7a10d548dcb29801b54c96c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:20Z,use_quota=True,user_id='6794b951b77c4f72ac3a20427ba1ba6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16df4fe-444a-4395-83f9-bcd28bde2db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16df4fe-444a-4395-83f9-bcd28bde2db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0125ebfc-ed40-4ae2-9be3-ff532a9ed13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0125ebfc-ed40-4ae2-9be3-ff532a9ed13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71fbb281-7de3-4a5e-ac47-8eaddae40980', 'volume_name': 'volume-71fbb281-7de3-4a5e-ac47-8eaddae40980', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93efd8f7-a8b6-4416-96b5-40904ddaca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93efd8f7-a8b6-4416-96b5-40904ddaca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70975cd-2dbd-43d7-aace-c68f9e7861ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:20 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Volume 71fbb281-7de3-4a5e-ac47-8eaddae40980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71fbb281-7de3-4a5e-ac47-8eaddae40980', 'volume_size': 1}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-288752638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fbb281-7de3-4a5e-ac47-8eaddae40980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e183d7a10d548dcb29801b54c96c8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:20Z,use_quota=True,user_id='6794b951b77c4f72ac3a20427ba1ba6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Creating volume 71fbb281-7de3-4a5e-ac47-8eaddae40980 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:20 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:20 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 1073741824
Apr 20 23:40:20 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:21 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 1073741824" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:21 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980
Apr 20 23:40:21 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (46bfb7eb-52ab-4ad5-87b9-41c1cdd8b10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1359e8c-6ed6-4b06-9fcf-fb0096e76ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1359e8c-6ed6-4b06-9fcf-fb0096e76ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-83030053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368d8364-80fc-4c5e-ad91-304166b1d945,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:22Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dca2a7-a0fd-470c-9b6e-834fecbfc558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dca2a7-a0fd-470c-9b6e-834fecbfc558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1149a47f-e416-4ff9-90a0-6c35733816f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1149a47f-e416-4ff9-90a0-6c35733816f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368d8364-80fc-4c5e-ad91-304166b1d945', 'volume_name': 'volume-368d8364-80fc-4c5e-ad91-304166b1d945', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30787042-892c-4d42-abc4-2ef06a894afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30787042-892c-4d42-abc4-2ef06a894afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a175844-eca3-4c95-b57b-43b6082b05d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Volume 368d8364-80fc-4c5e-ad91-304166b1d945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368d8364-80fc-4c5e-ad91-304166b1d945', 'volume_size': 1}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:21 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-83030053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368d8364-80fc-4c5e-ad91-304166b1d945,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:22Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Creating volume 368d8364-80fc-4c5e-ad91-304166b1d945 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:21 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70975cd-2dbd-43d7-aace-c68f9e7861ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71fbb281-7de3-4a5e-ac47-8eaddae40980', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:21 devstack sudo[88619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945 1073741824
Apr 20 23:40:21 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b962d850-39fb-4e1c-a225-e4ff98ed890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Volume volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 (71fbb281-7de3-4a5e-ac47-8eaddae40980): created successfully
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b962d850-39fb-4e1c-a225-e4ff98ed890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Flow 'volume_create_manager' (3e7ffa07-58e8-48f6-a287-851af8fa35b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-98871a0c-fc4a-429e-b4ee-266d40540aa5 tempest-VolumeQuotasAdminTestJSON-13159138 None] Created volume successfully.
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Flow 'volume_create_manager' (ad2c44be-c371-4d8a-b061-cd8d9598b34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a50094-4618-416c-9656-ea7ff2b1352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a50094-4618-416c-9656-ea7ff2b1352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1552155581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8c54d6-37ff-4756-8ae5-786afdedd88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429fd8894e63423d95dd30e334e05f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:22Z,use_quota=True,user_id='2eaa4a5a1d17405f9ef5508c1e9f7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aade4c-cc3d-4c12-af8e-b45aacad926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aade4c-cc3d-4c12-af8e-b45aacad926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ffdf97-3bc4-4da4-b625-0a6a8072f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ffdf97-3bc4-4da4-b625-0a6a8072f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8c54d6-37ff-4756-8ae5-786afdedd88a', 'volume_name': 'volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96b8ee0-d7b4-4ac0-af4d-30758a3cc1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96b8ee0-d7b4-4ac0-af4d-30758a3cc1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fd2f7d-61aa-4188-95d0-71ab9ddafc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Volume ea8c54d6-37ff-4756-8ae5-786afdedd88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a', 'volume_size': 1}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:22 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945 1073741824" returned: 0 in 0.534s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:22 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945
Apr 20 23:40:22 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:22 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945" returned: 0 in 0.427s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1552155581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8c54d6-37ff-4756-8ae5-786afdedd88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='429fd8894e63423d95dd30e334e05f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:22Z,use_quota=True,user_id='2eaa4a5a1d17405f9ef5508c1e9f7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Creating volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:22 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a175844-eca3-4c95-b57b-43b6082b05d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368d8364-80fc-4c5e-ad91-304166b1d945', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:22 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a 1073741824
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd52afd-dcde-4b51-a254-ef099175b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:22 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Volume volume-368d8364-80fc-4c5e-ad91-304166b1d945 (368d8364-80fc-4c5e-ad91-304166b1d945): created successfully
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd52afd-dcde-4b51-a254-ef099175b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (46bfb7eb-52ab-4ad5-87b9-41c1cdd8b10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-355802b7-75c0-4d87-bb2f-e13d2f9aebbc tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:40:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3d163108-6faa-4f59-aea3-e299e6e39b0c tempest-VolumeQuotasAdminTestJSON-983342864 None] Transfer volume completed successfully.
Apr 20 23:40:23 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a 1073741824" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:23 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a
Apr 20 23:40:23 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:23 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fd2f7d-61aa-4188-95d0-71ab9ddafc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaf0ce8-4242-4453-ac4d-548afeea8aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Volume volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a (ea8c54d6-37ff-4756-8ae5-786afdedd88a): created successfully
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaf0ce8-4242-4453-ac4d-548afeea8aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Flow 'volume_create_manager' (ad2c44be-c371-4d8a-b061-cd8d9598b34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Acquiring lock "cinder-71fbb281-7de3-4a5e-ac47-8eaddae40980-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-953c633c-95f7-4edb-a444-d203c5fa20eb tempest-VolumesSnapshotListTestJSON-2130719893 None] Created volume successfully.
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Lock "cinder-71fbb281-7de3-4a5e-ac47-8eaddae40980-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Acquiring lock "cinder-quobyte-71fbb281-7de3-4a5e-ac47-8eaddae40980" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Lock "cinder-quobyte-71fbb281-7de3-4a5e-ac47-8eaddae40980" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694fea2-cbf7-4dfe-91ce-536f061ff5a4]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:23 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980
Apr 20 23:40:23 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (06544e3c-1089-440c-8668-3a63c5ab8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addd094d-99e2-49db-9393-bb89e9da07d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addd094d-99e2-49db-9393-bb89e9da07d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2078373488',display_name='tempest-VolumesGetTest-Volume-424544217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:24Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00b6367-930c-464b-ab7d-b7cb1cbc8e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00b6367-930c-464b-ab7d-b7cb1cbc8e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4c04fa-74a8-4b9d-9f0c-c44b3a6a0bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4c04fa-74a8-4b9d-9f0c-c44b3a6a0bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2', 'volume_name': 'volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05cc944-cbfd-4a9d-be4d-48aa752da446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05cc944-cbfd-4a9d-be4d-48aa752da446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4256d9d9-20f5-41a7-ba15-fcfff90259d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Volume c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2', 'volume_size': 1}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2078373488',display_name='tempest-VolumesGetTest-Volume-424544217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:24Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Creating volume c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:24 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:24 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 1073741824
Apr 20 23:40:24 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:24 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:24 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980
Apr 20 23:40:24 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:24 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 1073741824" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:24 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71fbb281-7de3-4a5e-ac47-8eaddae40980" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Lock "cinder-quobyte-71fbb281-7de3-4a5e-ac47-8eaddae40980" released by "delete_volume" :: held 1.053s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:24 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2
Apr 20 23:40:24 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Created reservations ['7098e341-31a6-4e9d-a4d8-ff0f68b856e0', 'bca8c81a-f748-4fa4-95ae-5c66dfab9f7c', '8c64fcfa-9ab8-42c8-8932-bdbd0e2013fa', 'a9580203-627e-48c6-b2fa-6039ce445b45'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:24 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:24 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:25 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.834s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4256d9d9-20f5-41a7-ba15-fcfff90259d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2225e26-851a-49b8-b12b-65682d5f10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Creating offline snapshot 07a0a996-4a20-4c08-9edb-c0a7a36d8854 of volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:40:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Volume volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 (c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2): created successfully
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2225e26-851a-49b8-b12b-65682d5f10d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (06544e3c-1089-440c-8668-3a63c5ab8126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea1d84-697d-447a-86a2-c0da9d78eec5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-409271ad-88be-43ac-abd7-e61ed318df05 tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:40:25 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.411s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Deleted volume successfully.
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1e3cbffb-9e88-4c26-a588-78acde8b8331 tempest-VolumeQuotasAdminTestJSON-1414428829 None] Lock "cinder-71fbb281-7de3-4a5e-ac47-8eaddae40980-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:25 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a
Apr 20 23:40:25 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:25 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:25 devstack sudo[88695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 1G
Apr 20 23:40:25 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:26 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 1G" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:26 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:26 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Lock "cinder-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a681b1-6ab5-4f1c-9c08-3ad226eae4eb]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:26 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2
Apr 20 23:40:26 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:26 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:26 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 is being set with open permissions: ugo+rw
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:26 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:26 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:26 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:26 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2
Apr 20 23:40:26 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:27 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=284,cinder:SELECT=193,cinder:DELETE=26,cinder:INSERT=73 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:27 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info
Apr 20 23:40:27 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:27 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2" released by "delete_volume" :: held 1.014s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Created reservations ['2ffabbee-23b1-48dc-91d4-561f4a16e98c', '89fd807f-3b13-4e31-a45b-a66865500624', 'f697ecb2-ce03-4f04-a313-a4c9221f7936', 'c956eba3-6e6f-49fb-9517-10f1da666884'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:27 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:27 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:27 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:27 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info is being set with open permissions: ugo+rw
Apr 20 23:40:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:27 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info
Apr 20 23:40:27 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:28 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-19011310-6c81-4e8b-b74b-393b4956bcb3 tempest-VolumesGetTest-338659515 None] Lock "cinder-c9dfcbd3-28e0-4d35-b5e5-a6c0418335c2-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:28 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.info" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=205,cinder:UPDATE=254,cinder:INSERT=58,cinder:DELETE=19 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:40:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-89c02ab3-f339-4d9b-914f-8fb57a6c36e2 tempest-VolumesSnapshotListTestJSON-2130719893 None] Create snapshot completed successfully
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Creating offline snapshot 5e864a88-8f35-4aa4-8bc7-284b9e9c064a of volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd49b1-982a-48e5-901d-73c766bae251]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-368d8364-80fc-4c5e-ad91-304166b1d945-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Lock "cinder-368d8364-80fc-4c5e-ad91-304166b1d945-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-368d8364-80fc-4c5e-ad91-304166b1d945" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-368d8364-80fc-4c5e-ad91-304166b1d945" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[934dc8fe-7000-4915-baa1-348c047dae98]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:28 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:28 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:28 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945
Apr 20 23:40:28 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:29 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:29 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a 1G
Apr 20 23:40:29 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:29 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:29 devstack sudo[88739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945
Apr 20 23:40:29 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:29 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-368d8364-80fc-4c5e-ad91-304166b1d945" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-368d8364-80fc-4c5e-ad91-304166b1d945" released by "delete_volume" :: held 1.064s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:29 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a 1G" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:29 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:29 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Created reservations ['08509e1a-0bbb-4955-9bdb-d9d8a66b67e5', '422d45b3-844b-48d3-9bbc-31f6d064a8d2', '1e8addaa-8fb2-421a-80fb-b24b08ed4201', 'b0833c36-68a0-4296-adf9-b1320f71a093'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:29 devstack sudo[88747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:29 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:30 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:30 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a is being set with open permissions: ugo+rw
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:30 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:30 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:30 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-db772a7c-99b9-4d3c-8cf8-d92cbc214471 tempest-VolumesGetTest-338659515 None] Lock "cinder-368d8364-80fc-4c5e-ad91-304166b1d945-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:30 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fa126f69-8c3e-49bd-8a10-2e46e4f79a56 tempest-VolumesSnapshotListTestJSON-2130719893 None] Create snapshot completed successfully
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (bd379d51-3866-4825-8086-3c8b3f16ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becb7f94-75c1-4c96-b256-614bb3e5325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becb7f94-75c1-4c96-b256-614bb3e5325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-893464911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c81c66-8979-4231-aa9a-cf8d44f51cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:31Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27deadc0-1ca7-4db9-ba91-261fdfc1006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27deadc0-1ca7-4db9-ba91-261fdfc1006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351edc57-7518-4d55-b922-ea37e18149f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351edc57-7518-4d55-b922-ea37e18149f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'volume_name': 'volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e75ac02-2200-45bd-b1bc-ea8aac92dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e75ac02-2200-45bd-b1bc-ea8aac92dc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0dffa7-de5f-49a0-8073-65019c544f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:31 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Volume 26c81c66-8979-4231-aa9a-cf8d44f51cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'volume_size': 1}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-893464911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c81c66-8979-4231-aa9a-cf8d44f51cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:31Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Creating volume 26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:31 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:31 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 1073741824
Apr 20 23:40:31 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:31 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 1073741824" returned: 0 in 0.523s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:31 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:31 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:32 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.310s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0dffa7-de5f-49a0-8073-65019c544f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cbb1be-ca9d-4148-9e5a-51c87fa4f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Creating offline snapshot 95056446-d386-45dd-9507-8d3b87ce6a82 of volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:40:32 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Volume volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 (26c81c66-8979-4231-aa9a-cf8d44f51cb9): created successfully
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cbb1be-ca9d-4148-9e5a-51c87fa4f799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (bd379d51-3866-4825-8086-3c8b3f16ece8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b1db12-0423-4fb2-a3e0-b637ef97d600]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-019d6249-6294-4f8c-bf79-fea5c021e92d tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:40:32 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:32 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:32 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:32 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 1G
Apr 20 23:40:32 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:33 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 1G" returned: 0 in 0.595s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:33 devstack sudo[88775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82
Apr 20 23:40:33 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (5928666c-4c6f-4712-9c29-78a58b9f1e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53f7815-9852-4189-983a-4734c924a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53f7815-9852-4189-983a-4734c924a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1796539046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3173034f-c6b1-44f3-b155-bddc69fe3586,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=26c81c66-8979-4231-aa9a-cf8d44f51cb9,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:33Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f9ed71-097f-4a79-bfc8-9ba784917f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f9ed71-097f-4a79-bfc8-9ba784917f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3990af3d-c6e3-4d32-9b67-138b6a90694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3990af3d-c6e3-4d32-9b67-138b6a90694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3173034f-c6b1-44f3-b155-bddc69fe3586', 'volume_name': 'volume-3173034f-c6b1-44f3-b155-bddc69fe3586', 'volume_size': 1, 'source_volid': '26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae40d01-cde1-47b8-82eb-f4f6a1afad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae40d01-cde1-47b8-82eb-f4f6a1afad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b487a6-1a8c-4865-93c4-12d67da2a083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Volume 3173034f-c6b1-44f3-b155-bddc69fe3586: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3173034f-c6b1-44f3-b155-bddc69fe3586', 'volume_size': 1, 'source_volid': '26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'source_volstatus': 'available'}
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:33 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:33 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 is being set with open permissions: ugo+rw
Apr 20 23:40:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:33 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82
Apr 20 23:40:33 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:34 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.726s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:34 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Cloning volume 26c81c66-8979-4231-aa9a-cf8d44f51cb9 to volume 3173034f-c6b1-44f3-b155-bddc69fe3586
Apr 20 23:40:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-08b7abec-99f3-44a2-84ad-0e48abd90749 tempest-VolumesSnapshotListTestJSON-2130719893 None] Create snapshot completed successfully
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Creating offline snapshot b60db256-da3a-4360-af1a-7a2ab7865621 of volume 26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbdfbec-e616-4c0f-9211-bacc7e1967a8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:34 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:34 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:34 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:34 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 1G
Apr 20 23:40:34 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:35 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 1G" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:35 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621
Apr 20 23:40:35 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-95056446-d386-45dd-9507-8d3b87ce6a82-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-95056446-d386-45dd-9507-8d3b87ce6a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-95056446-d386-45dd-9507-8d3b87ce6a82" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-95056446-d386-45dd-9507-8d3b87ce6a82" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Deleting offline snapshot 95056446-d386-45dd-9507-8d3b87ce6a82 of volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] snapshot_file for this snap is: volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ec4d7-1ed9-431b-9205-040cd456c8a1]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:35 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82
Apr 20 23:40:35 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:35 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Flow 'volume_create_manager' (ef3f1113-d2f6-43bc-b118-9fc06420cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96ba30d-f593-4c4d-ba19-5341e9cc7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96ba30d-f593-4c4d-ba19-5341e9cc7bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-85082983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46daba4-a561-4aad-afa5-bc1cd09d97b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fdd64bf47d4183ae625b5bdbbc37c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:36Z,use_quota=True,user_id='874f5d0d5f3a42fd9e498d8a43be4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023a2c7e-2b5b-422a-8539-a785092e78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023a2c7e-2b5b-422a-8539-a785092e78d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cd096c-2a58-4d0a-97bd-070994c93982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cd096c-2a58-4d0a-97bd-070994c93982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46daba4-a561-4aad-afa5-bc1cd09d97b6', 'volume_name': 'volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530ed7c5-082e-49e7-b65d-13fd9509ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530ed7c5-082e-49e7-b65d-13fd9509ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34164268-02fa-486e-b6e2-382fdb28a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Volume e46daba4-a561-4aad-afa5-bc1cd09d97b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6', 'volume_size': 1}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:36 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 is being set with open permissions: ugo+rw
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:36 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621
Apr 20 23:40:36 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:36 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[06902907-8afd-418b-8fef-ba17604e4720]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:36 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:36 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:36 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:36 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info
Apr 20 23:40:36 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:36 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:36 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82
Apr 20 23:40:36 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:36 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info" returned: 0 in 0.411s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:36 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info is being set with open permissions: ugo+rw
Apr 20 23:40:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:36 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info
Apr 20 23:40:36 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:37 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:37 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82
Apr 20 23:40:37 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:37 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.info" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-3173034f-c6b1-44f3-b155-bddc69fe3586" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-3173034f-c6b1-44f3-b155-bddc69fe3586" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] snapshot: b60db256-da3a-4360-af1a-7a2ab7865621, volume: 3173034f-c6b1-44f3-b155-bddc69fe3586,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[269d36b8-2952-4a9e-8f69-8996cda49284]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:37 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621
Apr 20 23:40:37 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:37 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.95056446-d386-45dd-9507-8d3b87ce6a82" returned: 0 in 0.421s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-95056446-d386-45dd-9507-8d3b87ce6a82" released by "_delete_snapshot" :: held 1.942s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" released by "delete_snapshot" :: held 1.955s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Created reservations ['c12bcf1b-efd6-4222-9f85-0f496cad24f2', '2b59cc13-e174-4f07-b792-4a62627669d6', 'ade4b2d1-436f-48a8-a6ba-112a10dd4fbc', '4c38a21f-4560-482a-ab9f-3b34154d2f97'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Delete snapshot completed successfully.
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a6358b4c-e509-4419-aa8c-18fdd2b62cc0 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-95056446-d386-45dd-9507-8d3b87ce6a82-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-5e864a88-8f35-4aa4-8bc7-284b9e9c064a-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-5e864a88-8f35-4aa4-8bc7-284b9e9c064a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-5e864a88-8f35-4aa4-8bc7-284b9e9c064a" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-5e864a88-8f35-4aa4-8bc7-284b9e9c064a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Deleting offline snapshot 5e864a88-8f35-4aa4-8bc7-284b9e9c064a of volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] snapshot_file for this snap is: volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1444eb-a5e6-4b0a-a5bb-62507f7828c0]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:37 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[01162567-3736-4758-a4ff-115b079021b6]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:37 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:37 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:37 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:37 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:38 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d4aa77-063c-4ba7-b885-df196d45e643]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:38 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:38 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586
Apr 20 23:40:38 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:38 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:38 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:38 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.590s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:38 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:38 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:40 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 1.327s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:40 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a
Apr 20 23:40:40 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:40 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586" returned: 0 in 2.064s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ae9b3e-c45f-4b1e-a886-dee2e52d40d6]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:40 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:40 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:40 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.5e864a88-8f35-4aa4-8bc7-284b9e9c064a" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-5e864a88-8f35-4aa4-8bc7-284b9e9c064a" released by "_delete_snapshot" :: held 2.926s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" released by "delete_snapshot" :: held 2.938s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Created reservations ['a31f2509-d5ce-4168-800c-04674489d1a4', 'cb0f1256-382f-409e-b161-954622c67098', '8d0bbd01-8ae5-4148-a136-a5704587ee1f', '8afc11c2-915d-439b-b406-8492504f5540'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Delete snapshot completed successfully.
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a501f9b7-6d2b-4b0b-be47-7a48fa1304a8 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-5e864a88-8f35-4aa4-8bc7-284b9e9c064a-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-07a0a996-4a20-4c08-9edb-c0a7a36d8854-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-07a0a996-4a20-4c08-9edb-c0a7a36d8854-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-07a0a996-4a20-4c08-9edb-c0a7a36d8854" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-07a0a996-4a20-4c08-9edb-c0a7a36d8854" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Deleting offline snapshot 07a0a996-4a20-4c08-9edb-c0a7a36d8854 of volume ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:40:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] snapshot_file for this snap is: volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e78a7bc-37a9-44e2-a8ee-0a654c25ec7b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:41 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.621s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:40:41 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Converted 1024.00 MB image at 495.86 MB/s
Apr 20 23:40:41 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 is being set with open permissions: ugo+rw
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:41 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586
Apr 20 23:40:41 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:41 devstack sudo[88872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:41 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:41 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586" returned: 0 in 0.408s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-3173034f-c6b1-44f3-b155-bddc69fe3586" released by "_copy_volume_from_snapshot" :: held 4.115s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-b60db256-da3a-4360-af1a-7a2ab7865621" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-b60db256-da3a-4360-af1a-7a2ab7865621" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Deleting offline snapshot b60db256-da3a-4360-af1a-7a2ab7865621 of volume 26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] snapshot_file for this snap is: volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c6ee7-4d8b-4252-a9a9-fbfcf01a8d33]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:41 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ef934-2999-4dc7-a8df-493df1a8f9aa]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:41 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621
Apr 20 23:40:41 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:41 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a
Apr 20 23:40:41 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:41 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866ab97-ff5c-46b7-b486-7e1689338026]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:41 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:41 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:41 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:42 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:42 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:42 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:42 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:42 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621
Apr 20 23:40:42 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:42 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854
Apr 20 23:40:42 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:42 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:42 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a.07a0a996-4a20-4c08-9edb-c0a7a36d8854" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:42 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621
Apr 20 23:40:42 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-07a0a996-4a20-4c08-9edb-c0a7a36d8854" released by "_delete_snapshot" :: held 1.907s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" released by "delete_snapshot" :: held 1.925s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Created reservations ['f0b25a1b-dd48-42bc-9a76-9eda21378183', 'c5bf1028-bc7b-4dad-9051-96384ccf610f', 'd08a2dc8-08f4-4330-ab6f-189090c94097', '6145a7b6-8e3e-472f-b5ab-f6ba9205569a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Delete snapshot completed successfully.
Apr 20 23:40:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3249adea-05af-4961-a13e-1919edb5a48a tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-07a0a996-4a20-4c08-9edb-c0a7a36d8854-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-ea8c54d6-37ff-4756-8ae5-786afdedd88a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-ea8c54d6-37ff-4756-8ae5-786afdedd88a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55c1e9-770b-4b1a-b073-4501500867dc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:43 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a
Apr 20 23:40:43 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:43 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9.b60db256-da3a-4360-af1a-7a2ab7865621" returned: 0 in 0.428s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-b60db256-da3a-4360-af1a-7a2ab7865621" released by "_delete_snapshot" :: held 1.846s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.038s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.310s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-85082983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46daba4-a561-4aad-afa5-bc1cd09d97b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fdd64bf47d4183ae625b5bdbbc37c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:36Z,use_quota=True,user_id='874f5d0d5f3a42fd9e498d8a43be4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Creating volume e46daba4-a561-4aad-afa5-bc1cd09d97b6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:43 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b487a6-1a8c-4865-93c4-12d67da2a083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3173034f-c6b1-44f3-b155-bddc69fe3586', 'volume_size': 1, 'source_volid': '26c81c66-8979-4231-aa9a-cf8d44f51cb9', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:43 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 1073741824
Apr 20 23:40:43 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df412f81-6d95-4232-91ee-8cb856895281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Volume volume-3173034f-c6b1-44f3-b155-bddc69fe3586 (3173034f-c6b1-44f3-b155-bddc69fe3586): created successfully
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df412f81-6d95-4232-91ee-8cb856895281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (5928666c-4c6f-4712-9c29-78a58b9f1e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1562aaa5-5de6-430d-8709-a50b27267837 tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:40:43 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:43 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a
Apr 20 23:40:43 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:43 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 1073741824" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:43 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6
Apr 20 23:40:43 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:44 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ea8c54d6-37ff-4756-8ae5-786afdedd88a" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-quobyte-ea8c54d6-37ff-4756-8ae5-786afdedd88a" released by "delete_volume" :: held 0.973s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Created reservations ['d060fa1f-0cd8-4b11-a89f-0342489b5f5c', '3bb09c5c-c7bb-475d-8045-1c13daeb355b', 'bcd8fa8d-5d80-485b-b031-fa0cdec96d78', '3ad5d0bc-d820-4ed3-b1bd-8e474fefebe7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:44 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:44 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:44 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34164268-02fa-486e-b6e2-382fdb28a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b104aa4-5508-410f-9a47-7aca23aadf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Volume volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 (e46daba4-a561-4aad-afa5-bc1cd09d97b6): created successfully
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b104aa4-5508-410f-9a47-7aca23aadf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Flow 'volume_create_manager' (ef3f1113-d2f6-43bc-b118-9fc06420cf86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-34a7e274-6f9b-4b46-a22b-faf998619a7f tempest-VolumesListAdminTestJSON-288508898 None] Created volume successfully.
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (9094f657-0de9-4299-bbf5-e09b71120868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf907a9a-b75b-4bd2-bab6-f0c098f97e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf907a9a-b75b-4bd2-bab6-f0c098f97e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-920839080',display_name='tempest-VolumesGetTest-Volume-1864477144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557977dd-0368-474d-a8d5-1c7e6c41c3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:44Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8db86d5-572a-4c81-8870-344ae0f3bbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8db86d5-572a-4c81-8870-344ae0f3bbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bffab1-a69b-4cef-a4e6-911b6aea2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bffab1-a69b-4cef-a4e6-911b6aea2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557977dd-0368-474d-a8d5-1c7e6c41c3ed', 'volume_name': 'volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14746ba-1a86-46f5-a15b-1e46cba5f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14746ba-1a86-46f5-a15b-1e46cba5f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41876aa-53c8-4ddc-9b35-9415a64c6f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Volume 557977dd-0368-474d-a8d5-1c7e6c41c3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed', 'volume_size': 1}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-920839080',display_name='tempest-VolumesGetTest-Volume-1864477144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557977dd-0368-474d-a8d5-1c7e6c41c3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:44Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Creating volume 557977dd-0368-474d-a8d5-1c7e6c41c3ed {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:44 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:44 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed 1073741824
Apr 20 23:40:44 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:44 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Deleted volume successfully.
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dfda459d-df02-49f7-9f01-4135c3163148 tempest-VolumesSnapshotListTestJSON-2130719893 None] Lock "cinder-ea8c54d6-37ff-4756-8ae5-786afdedd88a-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Flow 'volume_create_manager' (8272a789-ebc8-4f29-8ed3-d88c7803ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c1468d-0c1c-45b8-a549-fb5770586311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c1468d-0c1c-45b8-a549-fb5770586311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254577516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09112eb-9de6-4512-a6d3-477bba34cc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fdd64bf47d4183ae625b5bdbbc37c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:45Z,use_quota=True,user_id='874f5d0d5f3a42fd9e498d8a43be4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2d8884-aa86-4cfd-896e-1989de9c0271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2d8884-aa86-4cfd-896e-1989de9c0271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea0fa4b-4cbf-4709-9ad1-073b21c92c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea0fa4b-4cbf-4709-9ad1-073b21c92c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09112eb-9de6-4512-a6d3-477bba34cc3e', 'volume_name': 'volume-d09112eb-9de6-4512-a6d3-477bba34cc3e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e640d7-1254-4c2e-855e-65651d5f8ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e640d7-1254-4c2e-855e-65651d5f8ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972d0568-b8e3-484c-bad7-4d9d5eb08fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Volume d09112eb-9de6-4512-a6d3-477bba34cc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09112eb-9de6-4512-a6d3-477bba34cc3e', 'volume_size': 1}
Apr 20 23:40:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:45 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed 1073741824" returned: 0 in 0.637s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:45 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed
Apr 20 23:40:45 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:45 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1254577516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09112eb-9de6-4512-a6d3-477bba34cc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fdd64bf47d4183ae625b5bdbbc37c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:45Z,use_quota=True,user_id='874f5d0d5f3a42fd9e498d8a43be4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Creating volume d09112eb-9de6-4512-a6d3-477bba34cc3e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:45 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41876aa-53c8-4ddc-9b35-9415a64c6f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6a8b62-952c-4f8e-9939-0390436b437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:45 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e 1073741824
Apr 20 23:40:45 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Volume volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed (557977dd-0368-474d-a8d5-1c7e6c41c3ed): created successfully
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6a8b62-952c-4f8e-9939-0390436b437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (9094f657-0de9-4299-bbf5-e09b71120868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cee8ee8a-266e-4047-a3cd-98b7d0cf60c2 tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (7a52c08e-028f-4dde-92a5-a14fb8c308fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739acb9c-8070-4b8b-857d-0893a1f8090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739acb9c-8070-4b8b-857d-0893a1f8090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139264090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72e00f1-85d4-49d5-8258-dd022e85f529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:46Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06faf473-32b2-4d2c-a227-e4b9891d4152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06faf473-32b2-4d2c-a227-e4b9891d4152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8f39fa-ea23-4582-8805-83fbb64f96bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8f39fa-ea23-4582-8805-83fbb64f96bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72e00f1-85d4-49d5-8258-dd022e85f529', 'volume_name': 'volume-e72e00f1-85d4-49d5-8258-dd022e85f529', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114f73a1-a343-403d-9996-f2677e9b48b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114f73a1-a343-403d-9996-f2677e9b48b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8115847-2b81-4f5f-9b5e-9e4b6a67db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume e72e00f1-85d4-49d5-8258-dd022e85f529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72e00f1-85d4-49d5-8258-dd022e85f529', 'volume_size': 1}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:46 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e 1073741824" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:46 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e
Apr 20 23:40:46 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:46 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139264090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72e00f1-85d4-49d5-8258-dd022e85f529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:46Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating volume e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:46 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972d0568-b8e3-484c-bad7-4d9d5eb08fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09112eb-9de6-4512-a6d3-477bba34cc3e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895220a2-33ff-4d79-b63c-0533b1aab726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:46 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 1073741824
Apr 20 23:40:46 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-557977dd-0368-474d-a8d5-1c7e6c41c3ed-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Volume volume-d09112eb-9de6-4512-a6d3-477bba34cc3e (d09112eb-9de6-4512-a6d3-477bba34cc3e): created successfully
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895220a2-33ff-4d79-b63c-0533b1aab726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Flow 'volume_create_manager' (8272a789-ebc8-4f29-8ed3-d88c7803ac18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Lock "cinder-557977dd-0368-474d-a8d5-1c7e6c41c3ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7534759b-7c31-4614-9ddf-ae9698f894ed tempest-VolumesListAdminTestJSON-288508898 None] Created volume successfully.
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-557977dd-0368-474d-a8d5-1c7e6c41c3ed" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-557977dd-0368-474d-a8d5-1c7e6c41c3ed" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e008cae-c80d-4d84-a852-59f7c0e83aca]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:46 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed
Apr 20 23:40:46 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:47 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 1073741824" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:47 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529
Apr 20 23:40:47 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Flow 'volume_create_manager' (3f654257-eb64-4e43-8d8e-64cd55d75f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6e816f-0d83-445d-b9df-fa138660e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6e816f-0d83-445d-b9df-fa138660e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-107232637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9eb107-33af-4918-b7c6-53674938904c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fdd64bf47d4183ae625b5bdbbc37c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:47Z,use_quota=True,user_id='874f5d0d5f3a42fd9e498d8a43be4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e441c9-e91f-44d5-9f9a-c97b998ff23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e441c9-e91f-44d5-9f9a-c97b998ff23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a867e136-b5db-44b0-ad78-7a0cf5390462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a867e136-b5db-44b0-ad78-7a0cf5390462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9eb107-33af-4918-b7c6-53674938904c', 'volume_name': 'volume-fd9eb107-33af-4918-b7c6-53674938904c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c53783-e801-4d3c-bfb5-c6aaa2b25188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:47 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c53783-e801-4d3c-bfb5-c6aaa2b25188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b2f9f8-fa9d-4ab8-bbf2-3b36a8ee3e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Volume fd9eb107-33af-4918-b7c6-53674938904c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9eb107-33af-4918-b7c6-53674938904c', 'volume_size': 1}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed" returned: 0 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:47 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed
Apr 20 23:40:47 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:47 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-107232637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9eb107-33af-4918-b7c6-53674938904c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fdd64bf47d4183ae625b5bdbbc37c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:47Z,use_quota=True,user_id='874f5d0d5f3a42fd9e498d8a43be4bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Creating volume fd9eb107-33af-4918-b7c6-53674938904c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:47 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8115847-2b81-4f5f-9b5e-9e4b6a67db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72e00f1-85d4-49d5-8258-dd022e85f529', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:47 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c 1073741824
Apr 20 23:40:47 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bed5b5-c15b-4f8f-8dbb-c65e8a2fc42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume volume-e72e00f1-85d4-49d5-8258-dd022e85f529 (e72e00f1-85d4-49d5-8258-dd022e85f529): created successfully
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bed5b5-c15b-4f8f-8dbb-c65e8a2fc42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (7a52c08e-028f-4dde-92a5-a14fb8c308fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ad1386c0-6d28-4c3b-b687-4e552b71cbf0 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created volume successfully.
Apr 20 23:40:47 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-557977dd-0368-474d-a8d5-1c7e6c41c3ed" returned: 0 in 0.413s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-557977dd-0368-474d-a8d5-1c7e6c41c3ed" released by "delete_volume" :: held 0.981s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Created reservations ['e51ccd6b-aefc-44fb-b56a-853d59c0c22d', '1e7395da-5b83-4906-98e2-825e67fd2e53', '31496fc8-0de7-4d6e-a6a5-7efd738dc0c8', 'bf365dc9-4bf0-4514-993f-ae8ba88655bb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:47 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:47 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:48 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c 1073741824" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:48 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c
Apr 20 23:40:48 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:48 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0a43fa96-aedd-455f-9457-b2d8740cc22a tempest-VolumesGetTest-338659515 None] Lock "cinder-557977dd-0368-474d-a8d5-1c7e6c41c3ed-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:48 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c" returned: 0 in 0.432s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.349s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b2f9f8-fa9d-4ab8-bbf2-3b36a8ee3e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9eb107-33af-4918-b7c6-53674938904c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa675875-fcf3-4f9e-968a-8246d694a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Volume volume-fd9eb107-33af-4918-b7c6-53674938904c (fd9eb107-33af-4918-b7c6-53674938904c): created successfully
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa675875-fcf3-4f9e-968a-8246d694a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Flow 'volume_create_manager' (3f654257-eb64-4e43-8d8e-64cd55d75f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating offline snapshot 28c04a93-087b-4f6b-a893-27b515abffb0 of volume e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb3c71-ebbf-45a5-b85e-64154e79500e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-27855b65-cb15-49f6-b986-0a6409299083 tempest-VolumesListAdminTestJSON-288508898 None] Created volume successfully.
Apr 20 23:40:48 devstack sudo[88974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529
Apr 20 23:40:48 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-3173034f-c6b1-44f3-b155-bddc69fe3586-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Lock "cinder-3173034f-c6b1-44f3-b155-bddc69fe3586-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-3173034f-c6b1-44f3-b155-bddc69fe3586" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-3173034f-c6b1-44f3-b155-bddc69fe3586" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b890bc7-0fc1-4dd8-9f6e-b8d78cfbe3f3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:48 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586
Apr 20 23:40:48 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:49 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:49 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 1G
Apr 20 23:40:49 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:49 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586" returned: 0 in 0.501s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:49 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586
Apr 20 23:40:49 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:49 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 1G" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72e00f1-85d4-49d5-8258-dd022e85f529 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:49 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72e00f1-85d4-49d5-8258-dd022e85f529 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0
Apr 20 23:40:49 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Flow 'volume_create_manager' (ff36a471-4268-4833-860c-5dc50918d3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c319bb-889a-4a20-9346-c9132336d722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c319bb-889a-4a20-9346-c9132336d722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9112b902-ac82-43c3-965b-63d7d4b06c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c794144e114c7181dde30a4c5255b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:50Z,use_quota=True,user_id='79f7e9f17cc3406abef59f059cd979cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7805832c-3067-4b2d-a872-62e7a8f7fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7805832c-3067-4b2d-a872-62e7a8f7fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e8561-8d20-423c-a091-a430cfd3e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e8561-8d20-423c-a091-a430cfd3e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9112b902-ac82-43c3-965b-63d7d4b06c17', 'volume_name': 'volume-9112b902-ac82-43c3-965b-63d7d4b06c17', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad3b3a-b67a-4edf-942b-515ca3d01429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad3b3a-b67a-4edf-942b-515ca3d01429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00c776b-8da0-4fc3-b652-e7b6e019cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Volume 9112b902-ac82-43c3-965b-63d7d4b06c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9112b902-ac82-43c3-965b-63d7d4b06c17', 'volume_size': 1}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:49 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-3173034f-c6b1-44f3-b155-bddc69fe3586" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-3173034f-c6b1-44f3-b155-bddc69fe3586" released by "delete_volume" :: held 0.960s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Created reservations ['06ff91bb-a419-4feb-984c-0f5a9a430c40', '8722feba-750d-4ca0-b03f-55e00f7d29ba', 'f334a417-bcda-4328-8306-6cdc59c5bddd', '16a6ed8e-a6e1-4f54-a64a-afb3cd757313'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:49 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:49 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-26c81c66-8979-4231-aa9a-cf8d44f51cb9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:50 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72e00f1-85d4-49d5-8258-dd022e85f529 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:50 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 is being set with open permissions: ugo+rw
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Lock "cinder-26c81c66-8979-4231-aa9a-cf8d44f51cb9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:50 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0
Apr 20 23:40:50 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-26c81c66-8979-4231-aa9a-cf8d44f51cb9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-26c81c66-8979-4231-aa9a-cf8d44f51cb9" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[93abab4c-6799-4c4d-9e8b-af5cbd893726]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:50 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:50 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:50 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-da23eea0-a2ce-4235-99df-3b1ede11646b tempest-VolumesGetTest-338659515 None] Lock "cinder-3173034f-c6b1-44f3-b155-bddc69fe3586-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:50 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0" returned: 0 in 0.427s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:50 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info
Apr 20 23:40:50 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:50 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:50 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9
Apr 20 23:40:50 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:50 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info" returned: 0 in 0.411s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:50 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info is being set with open permissions: ugo+rw
Apr 20 23:40:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:50 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info
Apr 20 23:40:50 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:51 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-26c81c66-8979-4231-aa9a-cf8d44f51cb9" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-26c81c66-8979-4231-aa9a-cf8d44f51cb9" released by "delete_volume" :: held 0.928s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Created reservations ['7e6bb1ea-53c1-4093-ab4a-c16a4f9d9a82', 'fdb4623e-cd2a-463d-adf7-bf88c5c9e530', 'd6833f3f-27e6-48a2-85d5-af48501076a7', '7e178334-cf71-45e2-a1d3-c768cb3ddd50'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:51 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:51 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:51 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.info" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9112b902-ac82-43c3-965b-63d7d4b06c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c794144e114c7181dde30a4c5255b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:50Z,use_quota=True,user_id='79f7e9f17cc3406abef59f059cd979cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Creating volume 9112b902-ac82-43c3-965b-63d7d4b06c17 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:51 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:51 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17 1073741824
Apr 20 23:40:51 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-48a42e3a-5e6e-4889-8dc1-e92e41e1b68a tempest-CreateVolumesFromSnapshotTest-2077826809 None] Create snapshot completed successfully
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (2030fde4-328a-4a01-86aa-a95cb4f4d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41fc90b-2da4-4113-a160-eff1dcf8ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41fc90b-2da4-4113-a160-eff1dcf8ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1396296326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79677f27-3c7c-4002-a830-12614b5705df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:52Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:51 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614f6fc5-59b9-4773-aae7-c2b85990757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614f6fc5-59b9-4773-aae7-c2b85990757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46b17df-e7bc-4a82-ad94-cdd2c59c5e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.image.glance [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15df32a1-0f95-49c0-82f8-f23e097de446 tempest-VolumesGetTest-338659515 None] Lock "cinder-26c81c66-8979-4231-aa9a-cf8d44f51cb9-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46b17df-e7bc-4a82-ad94-cdd2c59c5e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79677f27-3c7c-4002-a830-12614b5705df', 'volume_name': 'volume-79677f27-3c7c-4002-a830-12614b5705df', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93500664a0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7f811-5f8e-4527-b578-dfe9ed24b187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7f811-5f8e-4527-b578-dfe9ed24b187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92346da-8fe3-45bd-ad73-c71d37145219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Volume 79677f27-3c7c-4002-a830-12614b5705df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79677f27-3c7c-4002-a830-12614b5705df', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93500664a0>}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Trying to clone 79677f27-3c7c-4002-a830-12614b5705df from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 23:40:51 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17 1073741824" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:52 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17
Apr 20 23:40:52 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 23:40:52 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaebf65-a59e-4ae5-82a5-9e737a8a50f7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:52 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD
Apr 20 23:40:52 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:52 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00c776b-8da0-4fc3-b652-e7b6e019cf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9112b902-ac82-43c3-965b-63d7d4b06c17', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bd3448-bfc5-45a2-bbff-5a1fcc299ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Volume volume-9112b902-ac82-43c3-965b-63d7d4b06c17 (9112b902-ac82-43c3-965b-63d7d4b06c17): created successfully
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bd3448-bfc5-45a2-bbff-5a1fcc299ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Flow 'volume_create_manager' (ff36a471-4268-4833-860c-5dc50918d3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e49f6dbc-b971-42b2-b1fd-299e21bcb7f9 tempest-VolumesListAdminTestJSON-113963520 None] Created volume successfully.
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:52 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (204f9fea-9648-44af-abf6-8fc3cbdefce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4247c63e-3830-4e7c-a991-07edf419987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 is fetched for user e58ec6bf9a1a4063802918d2f2971b51. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4247c63e-3830-4e7c-a991-07edf419987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1619101613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1872d7-6acb-451b-a3c4-358b86cc8f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea77d8c-0c1f-43c8-95f1-bf4235327808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea77d8c-0c1f-43c8-95f1-bf4235327808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6cb756-01b0-4c30-871a-b859b9264c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6cb756-01b0-4c30-871a-b859b9264c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1872d7-6acb-451b-a3c4-358b86cc8f70', 'volume_name': 'volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1e8d8b-3616-4b14-a62d-2863f14326fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1e8d8b-3616-4b14-a62d-2863f14326fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f1d010-efec-4051-b3b9-cb2ad49ab7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume ba1872d7-6acb-451b-a3c4-358b86cc8f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70', 'volume_size': 1}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1619101613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1872d7-6acb-451b-a3c4-358b86cc8f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating volume ba1872d7-6acb-451b-a3c4-358b86cc8f70 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:52 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:52 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 1073741824
Apr 20 23:40:52 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd32c6e-ca62-42a2-90ad-0fc1b32afdd7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (ad6360bf-a1ce-4c44-b027-6aa13bb155aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f25b1e-43d8-4f88-a8ea-9aa8693ad49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f25b1e-43d8-4f88-a8ea-9aa8693ad49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843417326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cccd06-c9a9-4081-b0c5-547adb0812fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd814e6f-bdc5-4a11-b916-2d0b0bd9552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd814e6f-bdc5-4a11-b916-2d0b0bd9552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2abd173-2519-4cd2-9c9a-ea7d4647029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2abd173-2519-4cd2-9c9a-ea7d4647029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67cccd06-c9a9-4081-b0c5-547adb0812fb', 'volume_name': 'volume-67cccd06-c9a9-4081-b0c5-547adb0812fb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586cc033-d816-48b8-a5e8-9351c28f1763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586cc033-d816-48b8-a5e8-9351c28f1763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c0ad28-bf55-4509-87a1-3b7567caccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume 67cccd06-c9a9-4081-b0c5-547adb0812fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67cccd06-c9a9-4081-b0c5-547adb0812fb', 'volume_size': 1}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Acquiring lock "cinder-9112b902-ac82-43c3-965b-63d7d4b06c17-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Lock "cinder-9112b902-ac82-43c3-965b-63d7d4b06c17-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (fde3a05c-960f-44e8-8a76-525671f4f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d45d64e-4558-41ea-8b85-3f6dad5ea3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d45d64e-4558-41ea-8b85-3f6dad5ea3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999452666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550ad0f4-2601-4f82-b824-3d07f6cb17fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2064f05b-25ba-4311-a629-a4669bda4289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2064f05b-25ba-4311-a629-a4669bda4289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18858dc4-8238-4326-99cf-ff2575b66f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18858dc4-8238-4326-99cf-ff2575b66f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550ad0f4-2601-4f82-b824-3d07f6cb17fa', 'volume_name': 'volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829f070a-0c33-4eab-9db2-d683a59cbb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829f070a-0c33-4eab-9db2-d683a59cbb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cc7ff0-c9a1-438f-b234-1d0e53301880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume 550ad0f4-2601-4f82-b824-3d07f6cb17fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa', 'volume_size': 1}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Acquiring lock "cinder-quobyte-9112b902-ac82-43c3-965b-63d7d4b06c17" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Lock "cinder-quobyte-9112b902-ac82-43c3-965b-63d7d4b06c17" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "cinder-fd9eb107-33af-4918-b7c6-53674938904c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1998c-4e9b-467b-a381-088412994760]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-fd9eb107-33af-4918-b7c6-53674938904c-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:53 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17
Apr 20 23:40:53 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (35e3db06-a95a-4593-bb2d-338e512b325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:53 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb0b4f9-b2cd-4f1b-943b-b251dbf73120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb0b4f9-b2cd-4f1b-943b-b251dbf73120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839448534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e680bb-bf4a-4423-9dde-0ee4d26bf4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c16a7b-505c-4203-a710-1b30b93e943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c16a7b-505c-4203-a710-1b30b93e943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8544d0d-de01-4308-b3ad-7d6617df4e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8544d0d-de01-4308-b3ad-7d6617df4e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e680bb-bf4a-4423-9dde-0ee4d26bf4e6', 'volume_name': 'volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afaf434-fd0c-44d3-aa2e-c26be04478d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afaf434-fd0c-44d3-aa2e-c26be04478d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0a082a-68fc-4348-a5d4-12a1c939cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume 06e680bb-bf4a-4423-9dde-0ee4d26bf4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6', 'volume_size': 1}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 1073741824" returned: 0 in 0.776s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "cinder-quobyte-fd9eb107-33af-4918-b7c6-53674938904c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD" returned: 0 in 0.739s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-quobyte-fd9eb107-33af-4918-b7c6-53674938904c" acquired by "delete_volume" :: waited 0.042s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:53 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a651983-3ed3-4b68-8f92-cce0b688ce43]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:53 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (aa558b8e-29bd-4d21-b9db-dfc96998e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a5d9b2-3be6-4adf-be2c-c308017a42f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a5d9b2-3be6-4adf-be2c-c308017a42f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088993849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a74ad1-846f-4825-b12f-f363b1e2da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473336aa-0e17-4217-b249-d2f69e765445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473336aa-0e17-4217-b249-d2f69e765445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbfef38-04d5-4434-9ef1-ef7dfed91ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbfef38-04d5-4434-9ef1-ef7dfed91ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a74ad1-846f-4825-b12f-f363b1e2da76', 'volume_name': 'volume-d7a74ad1-846f-4825-b12f-f363b1e2da76', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38bd79-e654-4980-b0da-6c8b96b426cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38bd79-e654-4980-b0da-6c8b96b426cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c
Apr 20 23:40:53 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f335b62-422c-4d6e-adf8-915460f4d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume d7a74ad1-846f-4825-b12f-f363b1e2da76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a74ad1-846f-4825-b12f-f363b1e2da76', 'volume_size': 1}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:53 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:53 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17
Apr 20 23:40:53 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:53 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843417326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67cccd06-c9a9-4081-b0c5-547adb0812fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating volume 67cccd06-c9a9-4081-b0c5-547adb0812fb {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:53 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f1d010-efec-4051-b3b9-cb2ad49ab7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc47118-50aa-4488-96c5-43dfd71b7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:53 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb 1073741824
Apr 20 23:40:53 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 (ba1872d7-6acb-451b-a3c4-358b86cc8f70): created successfully
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc47118-50aa-4488-96c5-43dfd71b7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (204f9fea-9648-44af-abf6-8fc3cbdefce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-66b46b41-d2a6-40e3-b7da-76b76cf9d92b tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created volume successfully.
Apr 20 23:40:53 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c" returned: 0 in 0.485s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:53 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c
Apr 20 23:40:53 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:54 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9112b902-ac82-43c3-965b-63d7d4b06c17" returned: 0 in 0.421s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Lock "cinder-quobyte-9112b902-ac82-43c3-965b-63d7d4b06c17" released by "delete_volume" :: held 0.997s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Created reservations ['1447bf39-f8c8-4c3c-84d5-2e145a50087d', '21230044-6e70-4eca-902c-322033f66ad1', 'd73c3cec-4d1b-45a2-bcee-3aeca5fd5e02', '12fab45a-3c99-4e85-b460-3340c6203cc4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:54 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:54 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:54 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb 1073741824" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:54 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fd9eb107-33af-4918-b7c6-53674938904c" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-quobyte-fd9eb107-33af-4918-b7c6-53674938904c" released by "delete_volume" :: held 0.974s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:54 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb
Apr 20 23:40:54 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Created reservations ['c3821981-e5ea-4827-98d3-bd7bcc7d16e3', '0da8ac4a-a786-4423-8968-2ec29c295e68', '2ce4e348-20b1-4ccb-b26b-4480ea23d63d', '03fc6ad2-d28d-49c3-b075-71d5a7af2388'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:54 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:54 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:54 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Deleted volume successfully.
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e77123c-b1a9-4147-8bf3-0e51a0c2c40e tempest-VolumesListAdminTestJSON-113963520 None] Lock "cinder-9112b902-ac82-43c3-965b-63d7d4b06c17-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:54 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.719s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1999452666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550ad0f4-2601-4f82-b824-3d07f6cb17fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating volume 550ad0f4-2601-4f82-b824-3d07f6cb17fa {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:54 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c0ad28-bf55-4509-87a1-3b7567caccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67cccd06-c9a9-4081-b0c5-547adb0812fb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cd9393-d29b-4b11-afb6-cdc713c0f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:54 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa 1073741824
Apr 20 23:40:54 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume volume-67cccd06-c9a9-4081-b0c5-547adb0812fb (67cccd06-c9a9-4081-b0c5-547adb0812fb): created successfully
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cd9393-d29b-4b11-afb6-cdc713c0f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (ad6360bf-a1ce-4c44-b027-6aa13bb155aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e3a243df-7d71-4243-8291-960c7a296193 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created volume successfully.
Apr 20 23:40:54 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.411s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Deleted volume successfully.
Apr 20 23:40:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b00a24ee-857c-45f5-955c-37c2ffada350 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-fd9eb107-33af-4918-b7c6-53674938904c-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:55 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa 1073741824" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:55 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa
Apr 20 23:40:55 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "cinder-d09112eb-9de6-4512-a6d3-477bba34cc3e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-d09112eb-9de6-4512-a6d3-477bba34cc3e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "cinder-quobyte-d09112eb-9de6-4512-a6d3-477bba34cc3e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-quobyte-d09112eb-9de6-4512-a6d3-477bba34cc3e" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf966d5-c50f-46ad-a0bd-05ace277992e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:55 devstack sudo[89086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e
Apr 20 23:40:55 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:55 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839448534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e680bb-bf4a-4423-9dde-0ee4d26bf4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating volume 06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:55 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cc7ff0-c9a1-438f-b234-1d0e53301880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940c495d-29db-48e8-8586-4a145f79c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:55 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 1073741824
Apr 20 23:40:55 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa (550ad0f4-2601-4f82-b824-3d07f6cb17fa): created successfully
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940c495d-29db-48e8-8586-4a145f79c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (fde3a05c-960f-44e8-8a76-525671f4f863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bf5af516-75e9-463f-a3d3-7fb2c8051bf1 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created volume successfully.
Apr 20 23:40:56 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:56 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e
Apr 20 23:40:56 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:56 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 1073741824" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:56 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6
Apr 20 23:40:56 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:56 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d09112eb-9de6-4512-a6d3-477bba34cc3e" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-quobyte-d09112eb-9de6-4512-a6d3-477bba34cc3e" released by "delete_volume" :: held 0.946s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Created reservations ['53ffa528-0710-4f29-89f2-871dffcd2fd4', '9c5eccc9-1a51-429e-8483-8638451f5af4', 'aaf80ed8-8485-4856-a532-ea2265442a88', 'b4653169-e09e-4288-96e0-823403b55e16'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:56 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:56 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "cinder-e46daba4-a561-4aad-afa5-bc1cd09d97b6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-e46daba4-a561-4aad-afa5-bc1cd09d97b6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "cinder-quobyte-e46daba4-a561-4aad-afa5-bc1cd09d97b6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-quobyte-e46daba4-a561-4aad-afa5-bc1cd09d97b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ca6785-cfc8-4532-a6b3-2f6ef1df3542]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:56 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.337s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1396296326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79677f27-3c7c-4002-a830-12614b5705df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:52Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Creating volume 79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:56 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0a082a-68fc-4348-a5d4-12a1c939cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:56 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df 1073741824
Apr 20 23:40:56 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcb7d85-4017-4a92-8200-5c0ad114be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:56 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6
Apr 20 23:40:56 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 (06e680bb-bf4a-4423-9dde-0ee4d26bf4e6): created successfully
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcb7d85-4017-4a92-8200-5c0ad114be41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (35e3db06-a95a-4593-bb2d-338e512b325a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cebb3436-1295-42f5-9ac3-189a00983927 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created volume successfully.
Apr 20 23:40:56 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:56 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Deleted volume successfully.
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-44a187db-0646-4817-91e8-d000c4ba2e0b tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-d09112eb-9de6-4512-a6d3-477bba34cc3e-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:57 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:57 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df 1073741824" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:57 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6
Apr 20 23:40:57 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:57 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:40:57 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:57 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e46daba4-a561-4aad-afa5-bc1cd09d97b6" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-quobyte-e46daba4-a561-4aad-afa5-bc1cd09d97b6" released by "delete_volume" :: held 0.954s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:57 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.132s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088993849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a74ad1-846f-4825-b12f-f363b1e2da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7513dbcb315d48a0ae98c13e1d8125a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:40:53Z,use_quota=True,user_id='aaa84d8c082a44d49af1f5aab44b776b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Creating volume d7a74ad1-846f-4825-b12f-f363b1e2da76 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:40:57 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Created reservations ['6b1a108a-0445-40bb-a363-2ade9afb3d63', 'a2ac2670-18e2-4f7e-952c-f26d74a66bb6', 'b0d4bfc8-dce6-4459-8450-0970d80685d3', '6097fc77-aad6-4556-a8f0-4e612a01a2da'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:40:57 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 1073741824
Apr 20 23:40:57 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Attempting download of 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume 79677f27-3c7c-4002-a830-12614b5705df. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3830c1-9cce-43ae-88a1-d21d3f2996a7]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:57 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:40:57 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:57 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc
Apr 20 23:40:57 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:58 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 1073741824" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:58 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:40:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Deleted volume successfully.
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c9019-97a8-4dcd-914e-501991e06f75 tempest-VolumesListAdminTestJSON-288508898 None] Lock "cinder-e46daba4-a561-4aad-afa5-bc1cd09d97b6-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:40:58 devstack sudo[89135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76
Apr 20 23:40:58 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:58 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:58 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc
Apr 20 23:40:58 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:58 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f335b62-422c-4d6e-adf8-915460f4d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a74ad1-846f-4825-b12f-f363b1e2da76', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca8c499-5b29-4e0e-a2ec-4c3ab3cc1801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:40:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Volume volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 (d7a74ad1-846f-4825-b12f-f363b1e2da76): created successfully
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca8c499-5b29-4e0e-a2ec-4c3ab3cc1801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Flow 'volume_create_manager' (aa558b8e-29bd-4d21-b9db-dfc96998e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:40:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b7da56aa-855e-4941-b2de-428b195b8419 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created volume successfully.
Apr 20 23:40:58 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc" returned: 1 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_2p5w0zwc' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d9597-ea39-4ea9-b6e9-8320ea12f250]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:58 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD
Apr 20 23:40:58 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-d7a74ad1-846f-4825-b12f-f363b1e2da76-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-d7a74ad1-846f-4825-b12f-f363b1e2da76-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-d7a74ad1-846f-4825-b12f-f363b1e2da76" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:40:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-d7a74ad1-846f-4825-b12f-f363b1e2da76" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f87ff34-df38-48e5-a06c-e4a2144dabb6]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:59 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76
Apr 20 23:40:59 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:59 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:59 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:40:59 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:40:59 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:40:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:40:59 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76
Apr 20 23:40:59 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:00 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d7a74ad1-846f-4825-b12f-f363b1e2da76" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-d7a74ad1-846f-4825-b12f-f363b1e2da76" released by "delete_volume" :: held 1.104s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['739fce10-48a7-4fb8-b4bb-c593fa6b4703', 'c23fde8d-ba50-4d7a-8ac1-7281327d20c7', '313c7d6d-b375-4962-b0bd-1a6179d8a3a7', '5d247751-e239-41fb-b8af-4ff146bf0b3b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:00 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:00 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:00 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 0 in 0.995s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_gsix2eo7devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:41:00 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:00 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df 1G
Apr 20 23:41:00 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:00 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleted volume successfully.
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-095bcdcc-ea97-40ff-b5c8-b33c97a3dcca tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-d7a74ad1-846f-4825-b12f-f363b1e2da76-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:00 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df 1G" returned: 0 in 0.507s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d9b262-3362-45ad-8d63-098b6482b932]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:00 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:41:00 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7059cf-cb67-40bb-a2ef-f6acbc627e7b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:01 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6
Apr 20 23:41:01 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:01 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 0 in 0.534s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:01 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:41:01 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Flow 'volume_create_manager' (0e67c0b3-f2eb-4f86-919e-9ff433da9c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ec661b-6b51-470c-a281-4c1f9a13f90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ec661b-6b51-470c-a281-4c1f9a13f90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1866747653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d4c736-72e9-4e90-b92d-29604bf2a40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8021bb590e42539848b03478b5b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:02Z,use_quota=True,user_id='e8f11c7b91d34640870b4d666cd0f48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62080ac0-68ee-4841-8825-4a558e0e3567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62080ac0-68ee-4841-8825-4a558e0e3567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ee45c-58c8-46fe-9343-e3717d59e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.image.glance [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 23:41:01 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:01 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6
Apr 20 23:41:01 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ee45c-58c8-46fe-9343-e3717d59e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13d4c736-72e9-4e90-b92d-29604bf2a40d', 'volume_name': 'volume-13d4c736-72e9-4e90-b92d-29604bf2a40d', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93455c5480>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3685dde-348d-430b-8b11-6d337a7bd1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3685dde-348d-430b-8b11-6d337a7bd1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e2a563-ca92-49eb-a3a3-a82c78356945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Volume 13d4c736-72e9-4e90-b92d-29604bf2a40d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13d4c736-72e9-4e90-b92d-29604bf2a40d', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93455c5480>}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Trying to clone 13d4c736-72e9-4e90-b92d-29604bf2a40d from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 23:41:01 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 1 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Downloaded image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume 79677f27-3c7c-4002-a830-12614b5705df successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 for user e58ec6bf9a1a4063802918d2f2971b51 is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Marking volume 79677f27-3c7c-4002-a830-12614b5705df as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Copying metadata from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 to 79677f27-3c7c-4002-a830-12614b5705df. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Creating volume glance metadata for volume 79677f27-3c7c-4002-a830-12614b5705df backed by image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92346da-8fe3-45bd-ad73-c71d37145219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79677f27-3c7c-4002-a830-12614b5705df', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93500664a0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d10729-8ad5-46ad-b9d8-6fb66b9f0b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:01 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 23:41:01 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 23:41:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Volume volume-79677f27-3c7c-4002-a830-12614b5705df (79677f27-3c7c-4002-a830-12614b5705df): created successfully
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d10729-8ad5-46ad-b9d8-6fb66b9f0b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (2030fde4-328a-4a01-86aa-a95cb4f4d95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-50edd99c-1cb0-4e5f-b511-70c69e002960 tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f913f5c-9b49-45af-97de-10993cfd1f6d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:02 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD
Apr 20 23:41:02 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:02 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6" released by "delete_volume" :: held 0.957s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['3c00b4dd-e3ac-4824-bd31-d24770a86c3a', '07afb481-c498-4725-a075-4ebe8385ee58', '6aa763a0-6489-494f-90d9-b3c071b4e4f1', 'baaf40c6-ceea-4516-8aa8-19755885e82a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:02 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:02 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-550ad0f4-2601-4f82-b824-3d07f6cb17fa-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-550ad0f4-2601-4f82-b824-3d07f6cb17fa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-550ad0f4-2601-4f82-b824-3d07f6cb17fa" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-550ad0f4-2601-4f82-b824-3d07f6cb17fa" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed1e30-2e53-4141-af32-86691cd014ed]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:02 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa
Apr 20 23:41:02 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:02 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 is fetched for user e8f11c7b91d34640870b4d666cd0f48f. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (0ff16c6a-f9f3-4867-bb78-123c7190924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5eed00-04f6-44cb-9cce-fc780673f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5eed00-04f6-44cb-9cce-fc780673f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-779620258',display_name='tempest-VolumesGetTest-Volume-565426676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cc2072-24ac-4d47-b569-c951de6c39f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:03Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711b0ecf-81da-4a91-bb90-e0ca0491da92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711b0ecf-81da-4a91-bb90-e0ca0491da92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830882f9-9030-496a-8015-3935902e5d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830882f9-9030-496a-8015-3935902e5d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cc2072-24ac-4d47-b569-c951de6c39f1', 'volume_name': 'volume-68cc2072-24ac-4d47-b569-c951de6c39f1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffe8cc0-0b3f-49cb-a894-8e93705f155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffe8cc0-0b3f-49cb-a894-8e93705f155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45517ee-c3f5-4436-80b9-e5ebd953a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Volume 68cc2072-24ac-4d47-b569-c951de6c39f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cc2072-24ac-4d47-b569-c951de6c39f1', 'volume_size': 1}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-779620258',display_name='tempest-VolumesGetTest-Volume-565426676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cc2072-24ac-4d47-b569-c951de6c39f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e85614990b44e1f9caff5c8b239523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:03Z,use_quota=True,user_id='e58ec6bf9a1a4063802918d2f2971b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Creating volume 68cc2072-24ac-4d47-b569-c951de6c39f1 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:02 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:02 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1 1073741824
Apr 20 23:41:02 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3dee0c-6d32-4d5f-83d0-b212143805c6]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:02 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleted volume successfully.
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-17175b03-2322-4a58-a827-ae2557da0f37 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-06e680bb-bf4a-4423-9dde-0ee4d26bf4e6-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:02 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD
Apr 20 23:41:02 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:02 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:02 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa
Apr 20 23:41:02 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:03 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1 1073741824" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:03 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1
Apr 20 23:41:03 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:03 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:03 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-550ad0f4-2601-4f82-b824-3d07f6cb17fa" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-550ad0f4-2601-4f82-b824-3d07f6cb17fa" released by "delete_volume" :: held 0.961s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['f0d11092-ef77-4d42-8d57-ab137f2bb1b2', '7484be45-bb6c-45bf-aae9-c0231a1631e7', 'b34b0129-450e-4d38-bf99-aff02506ddc3', 'd2e0949a-bfd0-4117-b818-5d4326fdec85'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:03 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:03 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-67cccd06-c9a9-4081-b0c5-547adb0812fb-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-67cccd06-c9a9-4081-b0c5-547adb0812fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-67cccd06-c9a9-4081-b0c5-547adb0812fb" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-67cccd06-c9a9-4081-b0c5-547adb0812fb" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f50b05-9519-42e5-9cbf-3c0e6d3a19dd]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:03 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb
Apr 20 23:41:03 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:03 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1" returned: 0 in 0.417s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1866747653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d4c736-72e9-4e90-b92d-29604bf2a40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a8021bb590e42539848b03478b5b7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:02Z,use_quota=True,user_id='e8f11c7b91d34640870b4d666cd0f48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Creating volume 13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:03 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45517ee-c3f5-4436-80b9-e5ebd953a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cc2072-24ac-4d47-b569-c951de6c39f1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:03 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d 1073741824
Apr 20 23:41:03 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32cc44e-58af-4b99-a438-d6c1727ecce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Volume volume-68cc2072-24ac-4d47-b569-c951de6c39f1 (68cc2072-24ac-4d47-b569-c951de6c39f1): created successfully
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32cc44e-58af-4b99-a438-d6c1727ecce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Flow 'volume_create_manager' (0ff16c6a-f9f3-4867-bb78-123c7190924b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-be4a1341-0346-49a4-bb4d-eba4f733de90 tempest-VolumesGetTest-338659515 None] Created volume successfully.
Apr 20 23:41:03 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleted volume successfully.
Apr 20 23:41:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5b7f44c-020a-4ed2-977f-f4daf3a13e91 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-550ad0f4-2601-4f82-b824-3d07f6cb17fa-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:04 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:04 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb
Apr 20 23:41:04 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:04 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d 1073741824" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:04 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:04 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:04 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-67cccd06-c9a9-4081-b0c5-547adb0812fb" returned: 0 in 0.415s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-67cccd06-c9a9-4081-b0c5-547adb0812fb" released by "delete_volume" :: held 0.957s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['8dcdaad5-7867-43bc-b79f-3b0445260f9d', '48433e00-8340-4f99-b4ea-49229e758fb5', '6d8ce182-2c4c-49fd-a981-ec2772ff8934', '76acd70c-2524-498b-8607-44b957f3ee11'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:04 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:04 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-ba1872d7-6acb-451b-a3c4-358b86cc8f70-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-ba1872d7-6acb-451b-a3c4-358b86cc8f70-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:04 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-ba1872d7-6acb-451b-a3c4-358b86cc8f70" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-ba1872d7-6acb-451b-a3c4-358b86cc8f70" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Attempting download of 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume 13d4c736-72e9-4e90-b92d-29604bf2a40d. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e10641-608a-4403-94b2-732d0e705db5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e03b18-cf28-4a2d-b011-2d357e25fcb5]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:04 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70
Apr 20 23:41:04 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:04 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4
Apr 20 23:41:04 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-68cc2072-24ac-4d47-b569-c951de6c39f1-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Lock "cinder-68cc2072-24ac-4d47-b569-c951de6c39f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-68cc2072-24ac-4d47-b569-c951de6c39f1" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-68cc2072-24ac-4d47-b569-c951de6c39f1" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102197a-9836-4419-803b-b27bbeb6e3f3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleted volume successfully.
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2020ff3-3830-4237-b611-a05dfaad8024 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-67cccd06-c9a9-4081-b0c5-547adb0812fb-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:05 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1
Apr 20 23:41:05 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70
Apr 20 23:41:05 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4
Apr 20 23:41:05 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1
Apr 20 23:41:05 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba1872d7-6acb-451b-a3c4-358b86cc8f70" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-ba1872d7-6acb-451b-a3c4-358b86cc8f70" released by "delete_volume" :: held 0.940s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['1461b44e-959a-4522-818a-4f185a9be047', '3e6d25bf-4f34-4a0e-84d7-8dcbd7f068ba', '9ddd223b-cae0-45b1-87ec-a64b61de5f96', '15f481c9-c432-479c-a5b6-6114810992cf'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-28c04a93-087b-4f6b-a893-27b515abffb0-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:05 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:05 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4" returned: 1 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e57ced6-2bfa-43d8-ba72-0236d3fe9957_is_we6s4' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df09b6-9822-4ecd-92ee-9f613a8c780b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-28c04a93-087b-4f6b-a893-27b515abffb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-e72e00f1-85d4-49d5-8258-dd022e85f529" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-e72e00f1-85d4-49d5-8258-dd022e85f529" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-28c04a93-087b-4f6b-a893-27b515abffb0" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-28c04a93-087b-4f6b-a893-27b515abffb0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleting offline snapshot 28c04a93-087b-4f6b-a893-27b515abffb0 of volume e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] snapshot_file for this snap is: volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb4bbf-7db6-4362-ad90-a2b8fa490500]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:05 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD
Apr 20 23:41:05 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0
Apr 20 23:41:05 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:05 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-68cc2072-24ac-4d47-b569-c951de6c39f1" returned: 0 in 0.432s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-68cc2072-24ac-4d47-b569-c951de6c39f1" released by "delete_volume" :: held 0.945s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Created reservations ['f900a279-5f43-4f98-8be2-15fdf58b805d', '685708bd-0628-4419-a7aa-1657afd74102', '6a5f9422-89c2-4e18-bf7f-1dcf3377a3b0', 'b35962f1-ae7a-440e-a29f-7f81166ce614'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:06 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:06 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:06 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleted volume successfully.
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-890721ee-58cd-4955-b20f-e9cb42778e56 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-ba1872d7-6acb-451b-a3c4-358b86cc8f70-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:06 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:06 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72e00f1-85d4-49d5-8258-dd022e85f529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:41:06 devstack sudo[89288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:06 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d6a36-10d9-4ded-b7b9-7840c7c40be8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:06 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529
Apr 20 23:41:06 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:06 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-edc4586f-5b0c-4231-8ef3-c1807aedcca5 tempest-VolumesGetTest-338659515 None] Lock "cinder-68cc2072-24ac-4d47-b569-c951de6c39f1-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:06 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:06 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0
Apr 20 23:41:06 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:07 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 0 in 0.839s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e57ced6-2bfa-43d8-ba72-0236d3fe9957__ha5hbjodevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:41:07 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:07 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d 1G
Apr 20 23:41:07 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-79677f27-3c7c-4002-a830-12614b5705df-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Lock "cinder-79677f27-3c7c-4002-a830-12614b5705df-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Acquiring lock "cinder-quobyte-79677f27-3c7c-4002-a830-12614b5705df" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-79677f27-3c7c-4002-a830-12614b5705df" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887d5c2-0c13-4325-8f25-2e145b75a2ff]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:07 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:41:07 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:07 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:07 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0
Apr 20 23:41:07 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:07 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d 1G" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[976091d9-eeb8-4f23-b996-7649a4c32761]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:07 devstack sudo[89324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:07 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:07 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529.28c04a93-087b-4f6b-a893-27b515abffb0" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:07 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-28c04a93-087b-4f6b-a893-27b515abffb0" released by "_delete_snapshot" :: held 1.979s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-e72e00f1-85d4-49d5-8258-dd022e85f529" released by "delete_snapshot" :: held 1.994s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['d786fd76-0b7f-49e7-84ec-f4d91f030cce', 'c17b5b43-6317-4eba-b5e8-c173c03356da', '216b16db-b9b4-4411-b7f9-c0403b5bbb46', '4760b8a1-ac39-426c-9d2c-bd5a7ded800a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:07 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:41:07 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Delete snapshot completed successfully.
Apr 20 23:41:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a377dfa5-b78f-42d7-b7a5-e04e47de9add tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-28c04a93-087b-4f6b-a893-27b515abffb0-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:08 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:08 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:08 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:08 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 1 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:08 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df
Apr 20 23:41:08 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:08 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 1 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Downloaded image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}])) to volume 13d4c736-72e9-4e90-b92d-29604bf2a40d successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Temporary image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 for user e8f11c7b91d34640870b4d666cd0f48f is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Marking volume 13d4c736-72e9-4e90-b92d-29604bf2a40d as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Copying metadata from image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 to 13d4c736-72e9-4e90-b92d-29604bf2a40d. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Creating volume glance metadata for volume 13d4c736-72e9-4e90-b92d-29604bf2a40d backed by image 3e57ced6-2bfa-43d8-ba72-0236d3fe9957 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 23:41:08 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-79677f27-3c7c-4002-a830-12614b5705df" returned: 0 in 0.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Lock "cinder-quobyte-79677f27-3c7c-4002-a830-12614b5705df" released by "delete_volume" :: held 1.438s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e2a563-ca92-49eb-a3a3-a82c78356945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d4c736-72e9-4e90-b92d-29604bf2a40d', 'volume_size': 1, 'image_id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9867962c207f47b9bdee3c3122899cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e57ced6-2bfa-43d8-ba72-0236d3fe9957', 'created_at': datetime.datetime(2026, 4, 20, 21, 30, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 21, 30, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e57ced6-2bfa-43d8-ba72-0236d3fe9957/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93455c5480>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b8f6dc-c8ff-4b9c-9f7c-3e7e02d0a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Volume volume-13d4c736-72e9-4e90-b92d-29604bf2a40d (13d4c736-72e9-4e90-b92d-29604bf2a40d): created successfully
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b8f6dc-c8ff-4b9c-9f7c-3e7e02d0a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Flow 'volume_create_manager' (0e67c0b3-f2eb-4f86-919e-9ff433da9c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a9698b8e-2d83-406e-b1b7-41a2c81288a0 tempest-VolumesImageMetadata-765661894 None] Created volume successfully.
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Created reservations ['aa0f817e-c44f-4b4c-b9bb-8d31639486f7', 'e186c542-aa52-485f-9bbb-094313f898ec', 'f24f975d-3024-44e4-886f-ff3e0db327ca', '4a82ce58-5f61-4aaf-b5dc-1ad35f031ce0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:08 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:08 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-e72e00f1-85d4-49d5-8258-dd022e85f529-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-e72e00f1-85d4-49d5-8258-dd022e85f529-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "cinder-quobyte-e72e00f1-85d4-49d5-8258-dd022e85f529" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-e72e00f1-85d4-49d5-8258-dd022e85f529" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88da320-b6fa-4d96-afba-a56f6fb40f80]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:08 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529
Apr 20 23:41:08 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:09 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Deleted volume successfully.
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b02f9e3-21ab-47de-96c8-34c5c02ebf9f tempest-VolumesGetTest-338659515 None] Lock "cinder-79677f27-3c7c-4002-a830-12614b5705df-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Acquiring lock "cinder-13d4c736-72e9-4e90-b92d-29604bf2a40d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Lock "cinder-13d4c736-72e9-4e90-b92d-29604bf2a40d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Acquiring lock "cinder-quobyte-13d4c736-72e9-4e90-b92d-29604bf2a40d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Lock "cinder-quobyte-13d4c736-72e9-4e90-b92d-29604bf2a40d" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6dbd4-249e-4898-809a-f07fc18367b6]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:09 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:09 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:09 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:09 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529
Apr 20 23:41:09 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:09 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:09 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:09 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:09 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e72e00f1-85d4-49d5-8258-dd022e85f529" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-quobyte-e72e00f1-85d4-49d5-8258-dd022e85f529" released by "delete_volume" :: held 1.023s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Created reservations ['c2cca9ea-f769-4f3e-adfe-edb601d80688', 'cfdb4766-c323-43d3-bd93-0a2e1a32fe16', '7c415808-b022-4e07-b26d-dd5952cecebb', '087d1bca-eafd-4625-a632-4360c2fbe91f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:10 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:10 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:10 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 1 in 0.572s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:10 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d
Apr 20 23:41:10 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:10 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Deleted volume successfully.
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ddc15aec-1bc9-46a1-a4d4-ab162b83c169 tempest-CreateVolumesFromSnapshotTest-2077826809 None] Lock "cinder-e72e00f1-85d4-49d5-8258-dd022e85f529-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:10 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-13d4c736-72e9-4e90-b92d-29604bf2a40d" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Lock "cinder-quobyte-13d4c736-72e9-4e90-b92d-29604bf2a40d" released by "delete_volume" :: held 1.560s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Created reservations ['0854f0dd-2da9-4df7-bcbc-820798466b2a', 'd6ec6f3c-3cb8-43f3-96a9-3fea1e50a607', '15d1cf97-3cc4-42ee-b93f-422669883b5d', '8b660e75-8c09-47a8-96f2-22936c58270c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:10 devstack sudo[89371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:10 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Flow 'volume_create_manager' (30a5c9e9-4c7a-4c94-bc2b-6c607cd2da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5823e46-39c3-42f6-bf62-b1a1e0740322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5823e46-39c3-42f6-bf62-b1a1e0740322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2005433096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33d6c5d-685b-4acf-844a-af3304c04c1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf967ea73ae4512a4d5905266e656f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:11Z,use_quota=True,user_id='a8f7bfead0af43e296ceacb7d55a0dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb7f18d-a15b-4135-82ed-7e60961ae1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb7f18d-a15b-4135-82ed-7e60961ae1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187a417d-bcb4-44db-9136-e193a68d9694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187a417d-bcb4-44db-9136-e193a68d9694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33d6c5d-685b-4acf-844a-af3304c04c1e', 'volume_name': 'volume-f33d6c5d-685b-4acf-844a-af3304c04c1e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9669df-b2fe-4441-8807-03a4832b8904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9669df-b2fe-4441-8807-03a4832b8904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82c528e-9e86-4217-8dd2-c1bb7d375b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Volume f33d6c5d-685b-4acf-844a-af3304c04c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33d6c5d-685b-4acf-844a-af3304c04c1e', 'volume_size': 1}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2005433096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33d6c5d-685b-4acf-844a-af3304c04c1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf967ea73ae4512a4d5905266e656f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:11Z,use_quota=True,user_id='a8f7bfead0af43e296ceacb7d55a0dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Creating volume f33d6c5d-685b-4acf-844a-af3304c04c1e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:11 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:11 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e 1073741824
Apr 20 23:41:11 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:11 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Deleted volume successfully.
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-732ee875-4890-4a9b-a957-7b9edd7eaf8c tempest-VolumesImageMetadata-765661894 None] Lock "cinder-13d4c736-72e9-4e90-b92d-29604bf2a40d-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:11 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e 1073741824" returned: 0 in 0.610s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:11 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e
Apr 20 23:41:11 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:12 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82c528e-9e86-4217-8dd2-c1bb7d375b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33d6c5d-685b-4acf-844a-af3304c04c1e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f655ce-0828-4a97-86a0-21b169716707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Volume volume-f33d6c5d-685b-4acf-844a-af3304c04c1e (f33d6c5d-685b-4acf-844a-af3304c04c1e): created successfully
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f655ce-0828-4a97-86a0-21b169716707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Flow 'volume_create_manager' (30a5c9e9-4c7a-4c94-bc2b-6c607cd2da82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0d7009ac-2d6d-48fb-a332-a9dab497e762 tempest-VolumesListTestJSON-463521639 None] Created volume successfully.
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Flow 'volume_create_manager' (c573ac93-15cd-4405-b673-e7ad0e767849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22208f63-9cc2-4321-9c69-d0bc5e769d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22208f63-9cc2-4321-9c69-d0bc5e769d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552581567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f34e3b-f4e4-4f11-81ff-5d53527cfc79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf967ea73ae4512a4d5905266e656f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:14Z,use_quota=True,user_id='a8f7bfead0af43e296ceacb7d55a0dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddbd87e-7e30-416f-bd94-67ae0e97fee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddbd87e-7e30-416f-bd94-67ae0e97fee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84abdb1-8011-49f1-ba4d-64b8c5a0fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84abdb1-8011-49f1-ba4d-64b8c5a0fec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f34e3b-f4e4-4f11-81ff-5d53527cfc79', 'volume_name': 'volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673a8597-c58e-494f-b6f8-2c19346f7729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673a8597-c58e-494f-b6f8-2c19346f7729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8cbed42-a087-4e48-b2a9-97eb58f445de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Volume b3f34e3b-f4e4-4f11-81ff-5d53527cfc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79', 'volume_size': 1}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552581567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f34e3b-f4e4-4f11-81ff-5d53527cfc79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf967ea73ae4512a4d5905266e656f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:14Z,use_quota=True,user_id='a8f7bfead0af43e296ceacb7d55a0dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Creating volume b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:13 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:13 devstack sudo[89383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 1073741824
Apr 20 23:41:13 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:14 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 1073741824" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:14 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79
Apr 20 23:41:14 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:14 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8cbed42-a087-4e48-b2a9-97eb58f445de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5209e-5d9d-41d9-8f66-df009c7f2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Volume volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 (b3f34e3b-f4e4-4f11-81ff-5d53527cfc79): created successfully
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5209e-5d9d-41d9-8f66-df009c7f2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Flow 'volume_create_manager' (c573ac93-15cd-4405-b673-e7ad0e767849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2f739dc3-ac6d-42a2-a99f-e3911342eef7 tempest-VolumesListTestJSON-463521639 None] Created volume successfully.
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Flow 'volume_create_manager' (9202f189-d31b-4ff2-92aa-ab14951aea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87dfd2f-5986-4690-ad34-4499a949bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87dfd2f-5986-4690-ad34-4499a949bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1914045590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf30d29-b1c9-4978-b802-5b6013e671ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec06b6e298e47de8c16a1885e666de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:15Z,use_quota=True,user_id='7c743bf596ac48d8ba3a3c0cca0f216f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b705f6a-62d1-4ab0-9c7e-8a1525fdd5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b705f6a-62d1-4ab0-9c7e-8a1525fdd5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2573c6a-0b00-46d8-bf7e-7f67bb419576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2573c6a-0b00-46d8-bf7e-7f67bb419576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf30d29-b1c9-4978-b802-5b6013e671ac', 'volume_name': 'volume-bbf30d29-b1c9-4978-b802-5b6013e671ac', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac954e4a-709b-43fb-9497-93096f78cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac954e4a-709b-43fb-9497-93096f78cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca57591-508e-48c9-a8ee-942e6253d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Volume bbf30d29-b1c9-4978-b802-5b6013e671ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf30d29-b1c9-4978-b802-5b6013e671ac', 'volume_size': 1}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1914045590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf30d29-b1c9-4978-b802-5b6013e671ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec06b6e298e47de8c16a1885e666de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:15Z,use_quota=True,user_id='7c743bf596ac48d8ba3a3c0cca0f216f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Creating volume bbf30d29-b1c9-4978-b802-5b6013e671ac {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:15 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:15 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac 1073741824
Apr 20 23:41:15 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:15 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac 1073741824" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:15 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:15 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Flow 'volume_create_manager' (de8858ba-f887-42cf-9741-ee0719dda655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b416c94-9720-4b5c-a7ad-29469dfeea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:15 devstack sudo[89398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac
Apr 20 23:41:15 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b416c94-9720-4b5c-a7ad-29469dfeea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-913537149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99712d5d-e143-4dd6-9228-4d99d761cb63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf967ea73ae4512a4d5905266e656f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:16Z,use_quota=True,user_id='a8f7bfead0af43e296ceacb7d55a0dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bd163e-8750-4605-bc81-5575b451f13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bd163e-8750-4605-bc81-5575b451f13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc50887-f480-4295-a276-b31adcd1e0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc50887-f480-4295-a276-b31adcd1e0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99712d5d-e143-4dd6-9228-4d99d761cb63', 'volume_name': 'volume-99712d5d-e143-4dd6-9228-4d99d761cb63', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dbd38b-824a-4703-ad61-c367e6c3e389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dbd38b-824a-4703-ad61-c367e6c3e389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37ab0ce-4730-4ff8-bd91-4a477484fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Volume 99712d5d-e143-4dd6-9228-4d99d761cb63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99712d5d-e143-4dd6-9228-4d99d761cb63', 'volume_size': 1}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:16 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:16 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac" returned: 0 in 0.417s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-913537149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99712d5d-e143-4dd6-9228-4d99d761cb63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf967ea73ae4512a4d5905266e656f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:16Z,use_quota=True,user_id='a8f7bfead0af43e296ceacb7d55a0dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Creating volume 99712d5d-e143-4dd6-9228-4d99d761cb63 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:16 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca57591-508e-48c9-a8ee-942e6253d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf30d29-b1c9-4978-b802-5b6013e671ac', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4398a4ab-db69-44b1-9822-d5d348b1af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:16 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63 1073741824
Apr 20 23:41:16 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Volume volume-bbf30d29-b1c9-4978-b802-5b6013e671ac (bbf30d29-b1c9-4978-b802-5b6013e671ac): created successfully
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4398a4ab-db69-44b1-9822-d5d348b1af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Flow 'volume_create_manager' (9202f189-d31b-4ff2-92aa-ab14951aea3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-631f3c32-41c6-49d9-ac90-b4f78d0daa02 tempest-VolumesTransfersV357Test-1394143014 None] Created volume successfully.
Apr 20 23:41:16 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63 1073741824" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:16 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63
Apr 20 23:41:16 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:17 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37ab0ce-4730-4ff8-bd91-4a477484fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99712d5d-e143-4dd6-9228-4d99d761cb63', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba7fc11-9748-4a74-879c-b8a88b58e95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Volume volume-99712d5d-e143-4dd6-9228-4d99d761cb63 (99712d5d-e143-4dd6-9228-4d99d761cb63): created successfully
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba7fc11-9748-4a74-879c-b8a88b58e95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Flow 'volume_create_manager' (de8858ba-f887-42cf-9741-ee0719dda655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0da6f53c-3fa8-4a53-a314-8f70b6a37847 tempest-VolumesListTestJSON-463521639 None] Created volume successfully.
Apr 20 23:41:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fa0482a3-6016-409d-b486-ded380b5a802 tempest-VolumesTransfersV357Test-2019207541 None] Transfer volume completed successfully.
Apr 20 23:41:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Acquiring lock "cinder-bbf30d29-b1c9-4978-b802-5b6013e671ac-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-bbf30d29-b1c9-4978-b802-5b6013e671ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Acquiring lock "cinder-quobyte-bbf30d29-b1c9-4978-b802-5b6013e671ac" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-quobyte-bbf30d29-b1c9-4978-b802-5b6013e671ac" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e734fb6-f72a-4107-be15-08f82d4a78f9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:18 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac
Apr 20 23:41:18 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:19 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:19 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac
Apr 20 23:41:19 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:19 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bbf30d29-b1c9-4978-b802-5b6013e671ac" returned: 0 in 0.432s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-quobyte-bbf30d29-b1c9-4978-b802-5b6013e671ac" released by "delete_volume" :: held 0.977s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Created reservations ['4926f00b-98be-42c4-9bbe-4984a5b65beb', '7b439aee-57e2-49ca-a705-b634e3d1517b', 'd2ff272d-4383-45db-95b0-59c5bada9217', 'c1735e5a-f40a-41a8-a979-5f94fc1ab61d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:19 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:19 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "cinder-99712d5d-e143-4dd6-9228-4d99d761cb63-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-99712d5d-e143-4dd6-9228-4d99d761cb63-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "cinder-quobyte-99712d5d-e143-4dd6-9228-4d99d761cb63" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-quobyte-99712d5d-e143-4dd6-9228-4d99d761cb63" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba26436-d850-4437-b3a1-44eb3f5bb4c2]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:19 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63
Apr 20 23:41:19 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:20 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Deleted volume successfully.
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b259d5f1-e8f5-4a79-a68d-a3a0e625cf29 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-bbf30d29-b1c9-4978-b802-5b6013e671ac-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Flow 'volume_create_manager' (6bd5f332-3a65-447e-90ee-bee126c7182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5770b9d8-88f9-4837-8b34-d9727d419989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5770b9d8-88f9-4837-8b34-d9727d419989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-796046396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e5ad5f-779f-4da2-a177-7d6fab1bb427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec06b6e298e47de8c16a1885e666de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:20Z,use_quota=True,user_id='7c743bf596ac48d8ba3a3c0cca0f216f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02f5a70-6a92-4239-8635-fd82c884aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02f5a70-6a92-4239-8635-fd82c884aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d894a4-fff0-479a-a151-25e00696deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d894a4-fff0-479a-a151-25e00696deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e5ad5f-779f-4da2-a177-7d6fab1bb427', 'volume_name': 'volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8600461-1ab7-4530-9845-e3acb5ee60e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8600461-1ab7-4530-9845-e3acb5ee60e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e694b4c4-e347-4fbe-8d7b-e0ba29f8ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:20 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Volume 71e5ad5f-779f-4da2-a177-7d6fab1bb427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427', 'volume_size': 1}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-796046396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e5ad5f-779f-4da2-a177-7d6fab1bb427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec06b6e298e47de8c16a1885e666de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:20Z,use_quota=True,user_id='7c743bf596ac48d8ba3a3c0cca0f216f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Creating volume 71e5ad5f-779f-4da2-a177-7d6fab1bb427 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:20 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:20 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 1073741824
Apr 20 23:41:20 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:20 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:20 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63
Apr 20 23:41:20 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:20 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 1073741824" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:20 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427
Apr 20 23:41:20 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:20 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-99712d5d-e143-4dd6-9228-4d99d761cb63" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-quobyte-99712d5d-e143-4dd6-9228-4d99d761cb63" released by "delete_volume" :: held 0.940s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Created reservations ['57341b9a-52a9-4be6-9b08-79570aa8e9dc', '374ca0f0-6c0f-4bd7-9c85-87f441c0b684', '5755014c-a63c-486e-b194-88e2a3cd7199', 'd1a03855-4c3c-4e47-ae71-2e4ab7aeca4f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:20 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:20 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "cinder-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "cinder-quobyte-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-quobyte-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[038f152a-44f4-4fca-bc76-f37648c0370a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:21 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79
Apr 20 23:41:21 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:21 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e694b4c4-e347-4fbe-8d7b-e0ba29f8ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8e095e-4502-4ad1-86c5-dc34d6c84730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Volume volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 (71e5ad5f-779f-4da2-a177-7d6fab1bb427): created successfully
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8e095e-4502-4ad1-86c5-dc34d6c84730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Flow 'volume_create_manager' (6bd5f332-3a65-447e-90ee-bee126c7182f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7e912a19-577c-4fcc-878f-5425b5c6f7b9 tempest-VolumesTransfersV357Test-1394143014 None] Created volume successfully.
Apr 20 23:41:21 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Deleted volume successfully.
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1ccd60f0-7b35-4174-ad57-d22194244883 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-99712d5d-e143-4dd6-9228-4d99d761cb63-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:21 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:21 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79
Apr 20 23:41:21 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:21 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-quobyte-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79" released by "delete_volume" :: held 0.905s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Created reservations ['656a5246-ea49-4cf2-b249-420feabaf80b', '80913986-3766-49d8-b5c3-176ca0ad1aae', '9f1073ce-637b-4b29-afb5-f9b70f041332', 'bd9859ef-dd28-4cba-8d89-734ab7f31f6f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:22 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:22 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "cinder-f33d6c5d-685b-4acf-844a-af3304c04c1e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-f33d6c5d-685b-4acf-844a-af3304c04c1e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "cinder-quobyte-f33d6c5d-685b-4acf-844a-af3304c04c1e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-quobyte-f33d6c5d-685b-4acf-844a-af3304c04c1e" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[40524601-a69a-46a9-b559-e7ff64a93fee]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:22 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e
Apr 20 23:41:22 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:22 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Deleted volume successfully.
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7284d23f-f5ea-4dce-a3dd-b4460fd098f5 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-b3f34e3b-f4e4-4f11-81ff-5d53527cfc79-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Acquiring lock "cinder-71e5ad5f-779f-4da2-a177-7d6fab1bb427-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-71e5ad5f-779f-4da2-a177-7d6fab1bb427-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Acquiring lock "cinder-quobyte-71e5ad5f-779f-4da2-a177-7d6fab1bb427" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-quobyte-71e5ad5f-779f-4da2-a177-7d6fab1bb427" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f052e5-3287-4430-bf64-f5fde986b321]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:22 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427
Apr 20 23:41:22 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:22 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:22 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e
Apr 20 23:41:22 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:23 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:23 devstack sudo[89471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427
Apr 20 23:41:23 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:23 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f33d6c5d-685b-4acf-844a-af3304c04c1e" returned: 0 in 0.400s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-quobyte-f33d6c5d-685b-4acf-844a-af3304c04c1e" released by "delete_volume" :: held 0.955s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Created reservations ['866e0371-ae50-4de7-b37d-70b3ebb33c95', '98ab7666-3ed6-4e09-a437-bcdef6132027', 'f1405114-1481-4b66-8a0d-24c2be7f5f18', 'f437276b-7a8f-40d4-8d93-43b29599d252'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:23 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:23 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:23 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-71e5ad5f-779f-4da2-a177-7d6fab1bb427" returned: 0 in 0.421s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-quobyte-71e5ad5f-779f-4da2-a177-7d6fab1bb427" released by "delete_volume" :: held 0.929s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Created reservations ['d1c9a7ad-105f-4bfd-8404-4abe25016085', '1905c92b-237d-4f43-a8e1-b52b5f80b6b7', 'c6d6f671-0f08-46a7-a784-0d7ad3039ffe', '67731f19-ae15-464d-8477-8e352b2084c8'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:23 devstack sudo[89477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:23 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:23 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Deleted volume successfully.
Apr 20 23:41:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5bd39d86-d4ea-4a22-9667-37dcebb3e677 tempest-VolumesListTestJSON-463521639 None] Lock "cinder-f33d6c5d-685b-4acf-844a-af3304c04c1e-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:24 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:24 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Deleted volume successfully.
Apr 20 23:41:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03960750-90ee-4730-a4c9-402b38966e78 tempest-VolumesTransfersV357Test-1485310560 None] Lock "cinder-71e5ad5f-779f-4da2-a177-7d6fab1bb427-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (023d5a60-074c-4e5d-bbdc-c1f74fd45903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f082221-e3fc-4923-8394-7e57b8731d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f082221-e3fc-4923-8394-7e57b8731d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2122103267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65257a06-75ea-402f-a163-221c2f42509d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:25Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40942ada-0e17-4c92-9d75-62f430adc9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40942ada-0e17-4c92-9d75-62f430adc9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb92caae-1dcb-41d1-8238-9a613a4722ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb92caae-1dcb-41d1-8238-9a613a4722ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65257a06-75ea-402f-a163-221c2f42509d', 'volume_name': 'volume-65257a06-75ea-402f-a163-221c2f42509d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad14d145-6cb9-46ef-9c2b-2e4228599d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad14d145-6cb9-46ef-9c2b-2e4228599d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f39ec6-8ba1-448a-ba8d-00c80d6222ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Volume 65257a06-75ea-402f-a163-221c2f42509d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65257a06-75ea-402f-a163-221c2f42509d', 'volume_size': 1}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2122103267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65257a06-75ea-402f-a163-221c2f42509d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:25Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Creating volume 65257a06-75ea-402f-a163-221c2f42509d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:25 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:25 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d 1073741824
Apr 20 23:41:25 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (27964566-bc89-4568-b517-42671ed571ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117f6df0-46c9-4e44-acef-011ca1de5713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117f6df0-46c9-4e44-acef-011ca1de5713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854313458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e7ce88-d0a1-4628-a75f-a27a2d3fef4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:25Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbb3fe4-ce32-49ed-b01b-6118977aa39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbb3fe4-ce32-49ed-b01b-6118977aa39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e357045b-b3e8-4c83-9e26-9fa60c4f4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e357045b-b3e8-4c83-9e26-9fa60c4f4841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e7ce88-d0a1-4628-a75f-a27a2d3fef4d', 'volume_name': 'volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f504e229-3604-444d-9297-fb20f5ab5a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f504e229-3604-444d-9297-fb20f5ab5a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626ab99e-fac9-4730-90e5-39ee1aa70bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Volume 72e7ce88-d0a1-4628-a75f-a27a2d3fef4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d', 'volume_size': 1}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (51edd8ba-4b98-42a8-a6f4-98fd1e0ee296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428c83cb-87a8-4bbb-9d17-ea5705026758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428c83cb-87a8-4bbb-9d17-ea5705026758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1094124057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bf81be-2c5d-475c-b834-88acdc6dd8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:26Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4399ddc3-5369-44ed-b340-9458a03b478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4399ddc3-5369-44ed-b340-9458a03b478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b7c00a-9f01-4c43-8848-3b19837f7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b7c00a-9f01-4c43-8848-3b19837f7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03bf81be-2c5d-475c-b834-88acdc6dd8c9', 'volume_name': 'volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385d4316-d698-485e-9a69-2bdda112ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385d4316-d698-485e-9a69-2bdda112ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f319981-186a-49a9-917d-da16839c9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Volume 03bf81be-2c5d-475c-b834-88acdc6dd8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9', 'volume_size': 1}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (5e7037fe-e7e2-4d1e-b75c-4ca75a6fc604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36433d4e-c44f-4ca4-a126-d722aff2da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36433d4e-c44f-4ca4-a126-d722aff2da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1083598799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d142ede0-a4ac-4422-8eab-ab5fd15ccdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:26Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5189c1-6fd1-4532-bef9-66562430d9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5189c1-6fd1-4532-bef9-66562430d9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba52508-755f-424f-9ce6-44855f308b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba52508-755f-424f-9ce6-44855f308b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd142ede0-a4ac-4422-8eab-ab5fd15ccdc9', 'volume_name': 'volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596d59da-c578-48c9-9dd0-88745722edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596d59da-c578-48c9-9dd0-88745722edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f85d1b4-078a-420c-8767-e3d1ccfdc777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Volume d142ede0-a4ac-4422-8eab-ab5fd15ccdc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9', 'volume_size': 1}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:25 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d 1073741824" returned: 0 in 0.637s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:25 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d
Apr 20 23:41:25 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (e344e7f3-4b36-470c-a1f4-399d63504ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12df8b76-ae7d-4256-8e51-ac68628bc0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12df8b76-ae7d-4256-8e51-ac68628bc0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2122199659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adba742f-fe57-4f93-9e05-786f7cac2ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:26Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4a2254-a865-4abe-ba08-663292395b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4a2254-a865-4abe-ba08-663292395b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07be2539-c525-40fa-b1f0-f667f707dd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07be2539-c525-40fa-b1f0-f667f707dd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adba742f-fe57-4f93-9e05-786f7cac2ada', 'volume_name': 'volume-adba742f-fe57-4f93-9e05-786f7cac2ada', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ae383d-6b59-480e-9fa8-bbfc73683282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ae383d-6b59-480e-9fa8-bbfc73683282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f274f43c-be52-4530-8916-df23b490c169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Volume adba742f-fe57-4f93-9e05-786f7cac2ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adba742f-fe57-4f93-9e05-786f7cac2ada', 'volume_size': 1}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:26 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d" returned: 0 in 0.507s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854313458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e7ce88-d0a1-4628-a75f-a27a2d3fef4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:25Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Creating volume 72e7ce88-d0a1-4628-a75f-a27a2d3fef4d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:26 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f39ec6-8ba1-448a-ba8d-00c80d6222ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65257a06-75ea-402f-a163-221c2f42509d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:26 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d 1073741824
Apr 20 23:41:26 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54488b2-fd8a-42c9-bb7e-8849a924ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Volume volume-65257a06-75ea-402f-a163-221c2f42509d (65257a06-75ea-402f-a163-221c2f42509d): created successfully
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54488b2-fd8a-42c9-bb7e-8849a924ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (023d5a60-074c-4e5d-bbdc-c1f74fd45903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ee336da6-4d6b-4fe6-8e4e-92f834354166 tempest-CreateVolumesFromImageTest-1153712718 None] Created volume successfully.
Apr 20 23:41:26 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d 1073741824" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:27 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d
Apr 20 23:41:27 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:27 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1094124057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03bf81be-2c5d-475c-b834-88acdc6dd8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:26Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Creating volume 03bf81be-2c5d-475c-b834-88acdc6dd8c9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:27 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=225,cinder:INSERT=94,cinder:UPDATE=291,cinder:DELETE=17 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626ab99e-fac9-4730-90e5-39ee1aa70bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5a5d4e-94d4-417e-8818-10463ddc1cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:27 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 1073741824
Apr 20 23:41:27 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Volume volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d (72e7ce88-d0a1-4628-a75f-a27a2d3fef4d): created successfully
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5a5d4e-94d4-417e-8818-10463ddc1cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (27964566-bc89-4568-b517-42671ed571ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-36816bba-804a-4eb9-b1b5-0f3b3fa8c12b tempest-CreateVolumesFromImageTest-1153712718 None] Created volume successfully.
Apr 20 23:41:28 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 1073741824" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:28 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9
Apr 20 23:41:28 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:28 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.759s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1083598799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d142ede0-a4ac-4422-8eab-ab5fd15ccdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:26Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Creating volume d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f319981-186a-49a9-917d-da16839c9578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:28 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 1073741824
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574fc786-42fd-49a0-b9b4-0ddcb6ce3804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:28 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=286,cinder:SELECT=200,cinder:INSERT=67,cinder:DELETE=34 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:41:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Volume volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 (03bf81be-2c5d-475c-b834-88acdc6dd8c9): created successfully
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574fc786-42fd-49a0-b9b4-0ddcb6ce3804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (51edd8ba-4b98-42a8-a6f4-98fd1e0ee296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7569e87c-8144-4829-8fe3-d81912d1b35f tempest-CreateVolumesFromImageTest-1153712718 None] Created volume successfully.
Apr 20 23:41:29 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 1073741824" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:29 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9
Apr 20 23:41:29 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:29 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2122199659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adba742f-fe57-4f93-9e05-786f7cac2ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c39123a79b4135999fcbbea225bf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:26Z,use_quota=True,user_id='7b7ff53019324361a7c2e6cb9e42c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Creating volume adba742f-fe57-4f93-9e05-786f7cac2ada {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:29 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f85d1b4-078a-420c-8767-e3d1ccfdc777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:29 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada 1073741824
Apr 20 23:41:29 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec20ac-ead6-4d00-934e-258ba9bda9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Volume volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 (d142ede0-a4ac-4422-8eab-ab5fd15ccdc9): created successfully
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec20ac-ead6-4d00-934e-258ba9bda9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (5e7037fe-e7e2-4d1e-b75c-4ca75a6fc604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c1217752-04f2-4da1-9144-67f79d1c6b6f tempest-CreateVolumesFromImageTest-1153712718 None] Created volume successfully.
Apr 20 23:41:30 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada 1073741824" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:30 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada
Apr 20 23:41:30 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:30 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f274f43c-be52-4530-8916-df23b490c169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adba742f-fe57-4f93-9e05-786f7cac2ada', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a87f07-44d2-4b1c-91c4-49ab1fc0f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Volume volume-adba742f-fe57-4f93-9e05-786f7cac2ada (adba742f-fe57-4f93-9e05-786f7cac2ada): created successfully
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a87f07-44d2-4b1c-91c4-49ab1fc0f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Flow 'volume_create_manager' (e344e7f3-4b36-470c-a1f4-399d63504ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f8dc49af-73e6-4d8d-9eb9-bb1a89d39837 tempest-CreateVolumesFromImageTest-1153712718 None] Created volume successfully.
Apr 20 23:41:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-adba742f-fe57-4f93-9e05-786f7cac2ada-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-adba742f-fe57-4f93-9e05-786f7cac2ada-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-quobyte-adba742f-fe57-4f93-9e05-786f7cac2ada" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-adba742f-fe57-4f93-9e05-786f7cac2ada" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890c82c-2da0-4004-83e8-151c7e508b68]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:31 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada
Apr 20 23:41:31 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:32 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:32 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada
Apr 20 23:41:32 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:32 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-adba742f-fe57-4f93-9e05-786f7cac2ada" returned: 0 in 0.430s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-adba742f-fe57-4f93-9e05-786f7cac2ada" released by "delete_volume" :: held 0.987s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Flow 'volume_create_manager' (eab89794-56c5-4c1d-9f84-c959eea688ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726c1620-dceb-4d48-8190-435d390c237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726c1620-dceb-4d48-8190-435d390c237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127347267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1144652-c60a-4897-9bb5-6ea7a45e81ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36912b2f2b3d425580f20769dbc157c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:33Z,use_quota=True,user_id='12f39baac799422896c55e93cfc576b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9739b1e-1854-4074-936b-0f9e7e0940eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9739b1e-1854-4074-936b-0f9e7e0940eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304b3573-a94b-4b8a-b269-4f086bc434ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304b3573-a94b-4b8a-b269-4f086bc434ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1144652-c60a-4897-9bb5-6ea7a45e81ee', 'volume_name': 'volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b145d4-61d0-4755-ab53-402e4ae26378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b145d4-61d0-4755-ab53-402e4ae26378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4b4a0a-2bdd-4186-9d43-728839495ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:32 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Volume c1144652-c60a-4897-9bb5-6ea7a45e81ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee', 'volume_size': 1}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127347267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1144652-c60a-4897-9bb5-6ea7a45e81ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36912b2f2b3d425580f20769dbc157c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:33Z,use_quota=True,user_id='12f39baac799422896c55e93cfc576b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Creating volume c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:32 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Created reservations ['7eeb9392-88ff-4842-9f27-f47f1a351f24', '2214bff9-4048-4925-83ac-34bf6af16ab8', '3d95d841-fa2c-4431-b6d9-676f3d67ff98', '9542f578-5a01-4fe2-9439-3dd859c28355'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:32 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee 1073741824
Apr 20 23:41:32 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:32 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:32 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:33 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:33 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Deleted volume successfully.
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee 1073741824" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36a8e994-246a-45a7-ba35-a1877a485c4d tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-adba742f-fe57-4f93-9e05-786f7cac2ada-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:33 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:41:33 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:33 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4b4a0a-2bdd-4186-9d43-728839495ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b402f-c638-4375-af51-608651e1f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Volume volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee (c1144652-c60a-4897-9bb5-6ea7a45e81ee): created successfully
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b402f-c638-4375-af51-608651e1f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Flow 'volume_create_manager' (eab89794-56c5-4c1d-9f84-c959eea688ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5e51c458-2f98-471b-968b-61e5de0e4552 tempest-VolumesActionsTest-1692132607 None] Created volume successfully.
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-quobyte-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83b4e6-90d5-4512-a9c4-4b9b8df2cf19]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:33 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9
Apr 20 23:41:33 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:34 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:34 devstack sudo[89580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9
Apr 20 23:41:34 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:34 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9" returned: 0 in 0.396s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9" released by "delete_volume" :: held 0.880s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Created reservations ['cfa98369-1100-4a1c-9dcd-093fc47f1f21', '3180a63f-9f9a-41de-b23f-4831b3abd555', '14551953-b920-4ed9-adc0-9c024d2b0bb5', '76d99c20-37b2-438e-b564-cc42589c66fb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:34 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:34 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-03bf81be-2c5d-475c-b834-88acdc6dd8c9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-03bf81be-2c5d-475c-b834-88acdc6dd8c9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-quobyte-03bf81be-2c5d-475c-b834-88acdc6dd8c9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-03bf81be-2c5d-475c-b834-88acdc6dd8c9" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6273250e-60be-40f9-a808-2eea18280382]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:34 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9
Apr 20 23:41:34 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:35 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Deleted volume successfully.
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc5afbd9-c8b5-44f3-9e89-c2ea9538ece2 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-d142ede0-a4ac-4422-8eab-ab5fd15ccdc9-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:35 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9" returned: 0 in 0.560s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:35 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9
Apr 20 23:41:35 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:35 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-03bf81be-2c5d-475c-b834-88acdc6dd8c9" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-03bf81be-2c5d-475c-b834-88acdc6dd8c9" released by "delete_volume" :: held 1.063s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:35 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Created reservations ['aaffa02c-8999-4ef3-ab36-3da62a786165', 'f7c07b3a-fce4-43bf-91c4-0c36b3cd349e', '0642a8d8-397f-4d8e-8eaf-aeb106af7889', '1fbb4691-8bd3-4fa4-90f0-d65b832e1bf0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:36 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:36 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:36 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Deleted volume successfully.
Apr 20 23:41:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e4bab2d2-3d6b-4953-920b-c47394ef8a69 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-03bf81be-2c5d-475c-b834-88acdc6dd8c9-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-quobyte-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead9f19-73ba-46ff-8bbf-7d1c15e5fb62]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:37 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d
Apr 20 23:41:37 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:37 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:37 devstack sudo[89606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d
Apr 20 23:41:37 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:37 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d" returned: 0 in 0.395s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d" released by "delete_volume" :: held 0.910s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:37 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Created reservations ['06e2e972-51fe-496e-b53e-fd2fc5c4d78c', 'dc709dd1-93fe-4893-8ca3-5ff3bd445bfe', '05f4f6aa-b615-4473-b304-c9a50ee178b4', '17751de0-ced3-40d3-b8a1-2de4dd2bb1d8'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:38 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:38 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-65257a06-75ea-402f-a163-221c2f42509d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-65257a06-75ea-402f-a163-221c2f42509d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "cinder-quobyte-65257a06-75ea-402f-a163-221c2f42509d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-65257a06-75ea-402f-a163-221c2f42509d" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe8eff-d13b-4209-9152-37dfdb4a7136]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:38 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d
Apr 20 23:41:38 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:38 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Deleted volume successfully.
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fc0bbb4-29fe-45ec-b54f-42a742ffcad7 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-72e7ce88-d0a1-4628-a75f-a27a2d3fef4d-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:38 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:38 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d
Apr 20 23:41:38 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:39 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-65257a06-75ea-402f-a163-221c2f42509d" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-quobyte-65257a06-75ea-402f-a163-221c2f42509d" released by "delete_volume" :: held 0.938s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Created reservations ['74254032-a115-4234-8eef-272a063120d8', 'a04e6929-cbe5-4207-91ca-d5747884bcc2', '7c20e87c-dfcc-4ed0-8e22-1a2b699331aa', '027e2f55-9b94-40bb-aa3d-8c3f7d2079a6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:39 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:39 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:39 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Deleted volume successfully.
Apr 20 23:41:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-fe780bce-1842-47f0-8a3b-45932b4f46b4 tempest-CreateVolumesFromImageTest-1153712718 None] Lock "cinder-65257a06-75ea-402f-a163-221c2f42509d-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:40 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (5450459b-2c72-4008-8f73-9400fc9a68ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efcb274-5c36-465e-8bb8-3360c2b75ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efcb274-5c36-465e-8bb8-3360c2b75ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1262351880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ed96b6-410f-46ce-b789-3ad1aa5ec433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602114b3c934585b8c1ab0a79833136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:41Z,use_quota=True,user_id='33ef973b7e724a28a45ef4262ccf9c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f241a29-79ea-4ab2-87ee-e044a1d25d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f241a29-79ea-4ab2-87ee-e044a1d25d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b65195-b60e-478e-ace8-8baaad4bef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b65195-b60e-478e-ace8-8baaad4bef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ed96b6-410f-46ce-b789-3ad1aa5ec433', 'volume_name': 'volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7e052f-06a2-4862-a9b2-5bf920822090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7e052f-06a2-4862-a9b2-5bf920822090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc35340-b65b-40f5-9628-3aa3dd19a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:41 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Volume f4ed96b6-410f-46ce-b789-3ad1aa5ec433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433', 'volume_size': 1}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1262351880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ed96b6-410f-46ce-b789-3ad1aa5ec433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602114b3c934585b8c1ab0a79833136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:41Z,use_quota=True,user_id='33ef973b7e724a28a45ef4262ccf9c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Creating volume f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:41 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:41 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 1073741824
Apr 20 23:41:41 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:41 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 1073741824" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:41 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:41 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:42 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc35340-b65b-40f5-9628-3aa3dd19a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0fb7bc-67f4-473b-a156-27f3ea8638b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Volume volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 (f4ed96b6-410f-46ce-b789-3ad1aa5ec433): created successfully
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0fb7bc-67f4-473b-a156-27f3ea8638b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (5450459b-2c72-4008-8f73-9400fc9a68ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ef996568-61df-43bb-a123-546b9840b335 tempest-VolumeDependencyTests-1565816155 None] Created volume successfully.
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Creating offline snapshot 58eb48e3-937c-424f-8ddf-520e6deff0da of volume f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe57ca4d-e701-449c-a199-aed73bb485b9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:43 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:43 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:43 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:43 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da 1G
Apr 20 23:41:43 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:44 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da 1G" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:44 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da
Apr 20 23:41:44 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:44 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da is being set with open permissions: ugo+rw
Apr 20 23:41:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:44 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da
Apr 20 23:41:44 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:45 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:45 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info
Apr 20 23:41:45 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:45 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:45 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info is being set with open permissions: ugo+rw
Apr 20 23:41:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:45 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info
Apr 20 23:41:45 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:45 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.info" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bcd014f0-55a5-4637-b521-583047f3ee8c tempest-VolumeDependencyTests-1565816155 None] Create snapshot completed successfully
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (8ed5193a-0b41-490b-b296-55ba91d8abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110fdcc5-d058-4610-b8e9-d582446ae89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110fdcc5-d058-4610-b8e9-d582446ae89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1003147858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a21484-8bda-4d8b-811b-edbacf14848b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602114b3c934585b8c1ab0a79833136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58eb48e3-937c-424f-8ddf-520e6deff0da,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:47Z,use_quota=True,user_id='33ef973b7e724a28a45ef4262ccf9c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba72ae03-e5b6-428f-bb1d-1c94af488df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba72ae03-e5b6-428f-bb1d-1c94af488df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e6e48a-5df3-40d7-85e3-b900a948496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e6e48a-5df3-40d7-85e3-b900a948496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91a21484-8bda-4d8b-811b-edbacf14848b', 'volume_name': 'volume-91a21484-8bda-4d8b-811b-edbacf14848b', 'volume_size': 1, 'snapshot_id': '58eb48e3-937c-424f-8ddf-520e6deff0da'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e126982d-50f9-4197-b2e8-2f6051262870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e126982d-50f9-4197-b2e8-2f6051262870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aa8792-032b-4e94-a077-28c39fb0a07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Volume 91a21484-8bda-4d8b-811b-edbacf14848b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91a21484-8bda-4d8b-811b-edbacf14848b', 'volume_size': 1, 'snapshot_id': '58eb48e3-937c-424f-8ddf-520e6deff0da'}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-58eb48e3-937c-424f-8ddf-520e6deff0da-91a21484-8bda-4d8b-811b-edbacf14848b" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-58eb48e3-937c-424f-8ddf-520e6deff0da-91a21484-8bda-4d8b-811b-edbacf14848b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Creating volume 91a21484-8bda-4d8b-811b-edbacf14848b from snapshot 58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-91a21484-8bda-4d8b-811b-edbacf14848b" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-91a21484-8bda-4d8b-811b-edbacf14848b" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] snapshot: 58eb48e3-937c-424f-8ddf-520e6deff0da, volume: 91a21484-8bda-4d8b-811b-edbacf14848b,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c827f-5cf0-4f6a-96f5-5489edaf6acc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:47 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da
Apr 20 23:41:47 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:47 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67b91d-3fed-4f57-947a-953aabd36d03]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:47 devstack sudo[89710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:47 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:47 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.530s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:41:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:48 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b
Apr 20 23:41:48 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-224ed6f8-2221-4f13-8f42-c94f9acba91f tempest-VolumesActionsTest-1692132607 None] Acquiring lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee" by "attach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-224ed6f8-2221-4f13-8f42-c94f9acba91f tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee" acquired by "attach_volume" :: waited 0.032s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-224ed6f8-2221-4f13-8f42-c94f9acba91f tempest-VolumesActionsTest-1692132607 None] Attaching volume c1144652-c60a-4897-9bb5-6ea7a45e81ee to instance ef31509c-0ac6-47e8-9036-cb550e8dd688 at mountpoint /dev/vdb on host None.
Apr 20 23:41:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-224ed6f8-2221-4f13-8f42-c94f9acba91f tempest-VolumesActionsTest-1692132607 None] Attach volume completed successfully.
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-224ed6f8-2221-4f13-8f42-c94f9acba91f tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee" released by "attach_volume" :: held 0.332s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:50 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b" returned: 0 in 2.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd50fbd-288c-496f-893c-a8103398d52b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:50 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:50 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e617447-06f9-4e4b-ad4d-06fe7677a53d tempest-VolumesActionsTest-1692132607 None] Acquiring lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e617447-06f9-4e4b-ad4d-06fe7677a53d tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0e617447-06f9-4e4b-ad4d-06fe7677a53d tempest-VolumesActionsTest-1692132607 None] Detaching volume c1144652-c60a-4897-9bb5-6ea7a45e81ee from instance ef31509c-0ac6-47e8-9036-cb550e8dd688.
Apr 20 23:41:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0e617447-06f9-4e4b-ad4d-06fe7677a53d tempest-VolumesActionsTest-1692132607 None] Detach volume completed successfully.
Apr 20 23:41:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e617447-06f9-4e4b-ad4d-06fe7677a53d tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:51 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.614s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:41:51 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Converted 1024.00 MB image at 424.09 MB/s
Apr 20 23:41:51 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b is being set with open permissions: ugo+rw
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:51 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b
Apr 20 23:41:51 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:51 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-91a21484-8bda-4d8b-811b-edbacf14848b" released by "_copy_volume_from_snapshot" :: held 4.568s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-58eb48e3-937c-424f-8ddf-520e6deff0da-91a21484-8bda-4d8b-811b-edbacf14848b" released by "_create_volume_from_snapshot" :: held 4.590s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.603s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aa8792-032b-4e94-a077-28c39fb0a07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a21484-8bda-4d8b-811b-edbacf14848b', 'volume_size': 1, 'snapshot_id': '58eb48e3-937c-424f-8ddf-520e6deff0da'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3da5799-9649-4d3b-9363-1af5c19da26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Volume volume-91a21484-8bda-4d8b-811b-edbacf14848b (91a21484-8bda-4d8b-811b-edbacf14848b): created successfully
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3da5799-9649-4d3b-9363-1af5c19da26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (8ed5193a-0b41-490b-b296-55ba91d8abd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b14b1249-1bcf-466f-8322-75a74f5bce99 tempest-VolumeDependencyTests-1565816155 None] Created volume successfully.
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-58eb48e3-937c-424f-8ddf-520e6deff0da-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-58eb48e3-937c-424f-8ddf-520e6deff0da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-58eb48e3-937c-424f-8ddf-520e6deff0da" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-58eb48e3-937c-424f-8ddf-520e6deff0da" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Deleting offline snapshot 58eb48e3-937c-424f-8ddf-520e6deff0da of volume f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] snapshot_file for this snap is: volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cdfcc0-16fd-4c98-9837-2f9065f32148]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:52 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da
Apr 20 23:41:52 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:52 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da" returned: 0 in 0.583s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d14d41f-3682-4309-8b7c-49425d7db0f9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:52 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:52 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:53 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:53 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da
Apr 20 23:41:53 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:53 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:53 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da
Apr 20 23:41:53 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:54 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433.58eb48e3-937c-424f-8ddf-520e6deff0da" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-58eb48e3-937c-424f-8ddf-520e6deff0da" released by "_delete_snapshot" :: held 2.120s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" released by "delete_snapshot" :: held 2.135s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Created reservations ['bb2cccd0-b3d2-4670-9345-c3aa5ce289de', '6673df91-b3f6-4f8d-aa41-49fe5eaf9afb', '96927f39-3864-48cd-8554-54d2c21d074c', 'a7ba4712-5b96-4782-a750-25ba2d66d425'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Delete snapshot completed successfully.
Apr 20 23:41:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d2c06194-2af9-4f28-abbb-6f859cd7ab82 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-58eb48e3-937c-424f-8ddf-520e6deff0da-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-f4ed96b6-410f-46ce-b789-3ad1aa5ec433-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-f4ed96b6-410f-46ce-b789-3ad1aa5ec433-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d1c50f-7c38-4719-804f-faff6b341503]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:55 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:55 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:55 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.490s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:55 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433
Apr 20 23:41:55 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:56 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-f4ed96b6-410f-46ce-b789-3ad1aa5ec433" released by "delete_volume" :: held 0.946s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Created reservations ['1d8fd03f-a9cd-416b-a35e-ccf8e1825a16', 'afe87204-da35-407a-bd83-274912097cdc', '8825c76e-df3f-4d45-b6c1-548143b7654b', '9be717b3-a49f-4e55-af47-257c0d4fde37'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:56 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:41:56 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (e834eb75-8278-489a-a93d-0152ce68daa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014fc0c8-39f4-4859-bcf3-4731c65238a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014fc0c8-39f4-4859-bcf3-4731c65238a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-21880499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb63bd8d-5c3f-401c-b672-5ae723b7f450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602114b3c934585b8c1ab0a79833136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:57Z,use_quota=True,user_id='33ef973b7e724a28a45ef4262ccf9c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302affd1-8e0f-476d-8468-46b4eb411ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302affd1-8e0f-476d-8468-46b4eb411ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eac3b9b-65b8-46bd-97b9-7c33765df234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eac3b9b-65b8-46bd-97b9-7c33765df234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'volume_name': 'volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9168d48d-77e8-470a-827d-0c1dd487f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9168d48d-77e8-470a-827d-0c1dd487f671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff5aed9-fcd8-4f76-9855-e56a3fcb08b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Volume cb63bd8d-5c3f-401c-b672-5ae723b7f450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'volume_size': 1}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-21880499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb63bd8d-5c3f-401c-b672-5ae723b7f450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602114b3c934585b8c1ab0a79833136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:57Z,use_quota=True,user_id='33ef973b7e724a28a45ef4262ccf9c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Creating volume cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:41:56 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:56 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 1073741824
Apr 20 23:41:56 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:56 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:41:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Deleted volume successfully.
Apr 20 23:41:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ba25b03-eb86-478b-8005-6c90a6c79880 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-f4ed96b6-410f-46ce-b789-3ad1aa5ec433-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:41:57 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 1073741824" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:57 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:41:57 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:57 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff5aed9-fcd8-4f76-9855-e56a3fcb08b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062d4393-b6ad-4ffa-bbb6-01d717cdabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:57 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Volume volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 (cb63bd8d-5c3f-401c-b672-5ae723b7f450): created successfully
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062d4393-b6ad-4ffa-bbb6-01d717cdabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (e834eb75-8278-489a-a93d-0152ce68daa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8e187322-1c87-4afc-8048-bbe5546d88d3 tempest-VolumeDependencyTests-1565816155 None] Created volume successfully.
Apr 20 23:41:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:41:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (96a521ec-b936-43d6-95b7-fdfbe3d45679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41edf97-19a6-4bf2-8259-60f4481e7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41edf97-19a6-4bf2-8259-60f4481e7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-544899260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad42b22-b288-4942-b42a-b31cc2dcb19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7602114b3c934585b8c1ab0a79833136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cb63bd8d-5c3f-401c-b672-5ae723b7f450,status='creating',terminated_at=None,updated_at=2026-04-20T21:41:59Z,use_quota=True,user_id='33ef973b7e724a28a45ef4262ccf9c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cd3403-283d-4c1d-be73-af10d157b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cd3403-283d-4c1d-be73-af10d157b354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95329b21-27b8-405e-bad4-d0924e974cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95329b21-27b8-405e-bad4-d0924e974cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fad42b22-b288-4942-b42a-b31cc2dcb19d', 'volume_name': 'volume-fad42b22-b288-4942-b42a-b31cc2dcb19d', 'volume_size': 1, 'source_volid': 'cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e294435-0f75-4e08-8537-df62eecab353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e294435-0f75-4e08-8537-df62eecab353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf68ae0-a8d7-4dbf-92bf-0bf7f9f0f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:41:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Volume fad42b22-b288-4942-b42a-b31cc2dcb19d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fad42b22-b288-4942-b42a-b31cc2dcb19d', 'volume_size': 1, 'source_volid': 'cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'source_volstatus': 'available'}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:41:59 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Cloning volume cb63bd8d-5c3f-401c-b672-5ae723b7f450 to volume fad42b22-b288-4942-b42a-b31cc2dcb19d
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Creating offline snapshot b9bc2914-78c8-43fa-bce7-f1c4de830ec4 of volume cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bb4c8-7151-4903-9fb9-d524bac7e1a9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:59 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:41:59 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:41:59 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:41:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:41:59 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 1G
Apr 20 23:41:59 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:00 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 1G" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:00 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4
Apr 20 23:42:00 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:00 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:00 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 is being set with open permissions: ugo+rw
Apr 20 23:42:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:00 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4
Apr 20 23:42:00 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:00 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:00 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info
Apr 20 23:42:00 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:01 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info" returned: 0 in 0.427s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:01 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info is being set with open permissions: ugo+rw
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:01 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info
Apr 20 23:42:01 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:01 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.info" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-fad42b22-b288-4942-b42a-b31cc2dcb19d" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-fad42b22-b288-4942-b42a-b31cc2dcb19d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] snapshot: b9bc2914-78c8-43fa-bce7-f1c4de830ec4, volume: fad42b22-b288-4942-b42a-b31cc2dcb19d,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c888af-952b-4538-a042-72ce75de3b63]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:01 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4
Apr 20 23:42:01 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:02 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f717060-9d03-4df2-9019-0a060d606f83]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:02 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:42:02 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:02 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:42:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:02 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d
Apr 20 23:42:02 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:05 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d" returned: 0 in 2.230s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[022a89db-23b4-4068-9d15-6fddb26f12b6]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:05 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:42:05 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:05 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:05 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:42:05 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Converted 1024.00 MB image at 458.81 MB/s
Apr 20 23:42:05 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d is being set with open permissions: ugo+rw
Apr 20 23:42:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:05 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d
Apr 20 23:42:05 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:06 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-fad42b22-b288-4942-b42a-b31cc2dcb19d" released by "_copy_volume_from_snapshot" :: held 4.351s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-b9bc2914-78c8-43fa-bce7-f1c4de830ec4" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-b9bc2914-78c8-43fa-bce7-f1c4de830ec4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Deleting offline snapshot b9bc2914-78c8-43fa-bce7-f1c4de830ec4 of volume cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] snapshot_file for this snap is: volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bd2279-f8a6-4e34-bcc4-c28fb4a4c675]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:06 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4
Apr 20 23:42:06 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:06 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[128cbffb-8012-4648-84a8-1e7770e8021a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:06 devstack sudo[89888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:42:06 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:07 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:07 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4
Apr 20 23:42:07 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:07 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:07 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4
Apr 20 23:42:07 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:08 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450.b9bc2914-78c8-43fa-bce7-f1c4de830ec4" returned: 0 in 0.560s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-b9bc2914-78c8-43fa-bce7-f1c4de830ec4" released by "_delete_snapshot" :: held 2.002s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.123s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf68ae0-a8d7-4dbf-92bf-0bf7f9f0f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad42b22-b288-4942-b42a-b31cc2dcb19d', 'volume_size': 1, 'source_volid': 'cb63bd8d-5c3f-401c-b672-5ae723b7f450', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a9bf82-aeb6-4c0b-b11f-3a3aebdee070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Volume volume-fad42b22-b288-4942-b42a-b31cc2dcb19d (fad42b22-b288-4942-b42a-b31cc2dcb19d): created successfully
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a9bf82-aeb6-4c0b-b11f-3a3aebdee070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Flow 'volume_create_manager' (96a521ec-b936-43d6-95b7-fdfbe3d45679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ca554615-560a-4c7c-a5c4-877f605a8df6 tempest-VolumeDependencyTests-1565816155 None] Created volume successfully.
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-cb63bd8d-5c3f-401c-b672-5ae723b7f450-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-cb63bd8d-5c3f-401c-b672-5ae723b7f450-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-cb63bd8d-5c3f-401c-b672-5ae723b7f450" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-cb63bd8d-5c3f-401c-b672-5ae723b7f450" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6071147a-9f95-4e5e-bef1-b5df75cf8c5c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:08 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:42:08 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:09 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:09 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450
Apr 20 23:42:09 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:09 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-cb63bd8d-5c3f-401c-b672-5ae723b7f450" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-cb63bd8d-5c3f-401c-b672-5ae723b7f450" released by "delete_volume" :: held 0.991s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Created reservations ['18765136-34d3-411a-ac1d-298fa47079a9', '1e5a4523-6758-4c43-82e2-e6c7d8f25980', '13c57ac7-1928-490a-9838-6d6d8ddcd795', '0801ce93-9a5c-40ef-9158-a56afec7a327'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:09 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:09 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-fad42b22-b288-4942-b42a-b31cc2dcb19d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-fad42b22-b288-4942-b42a-b31cc2dcb19d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b540c09e-0f3f-4cda-b06d-293a5f2677a6 tempest-VolumesActionsTest-1692132607 None] Acquiring lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee" by "attach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-fad42b22-b288-4942-b42a-b31cc2dcb19d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b540c09e-0f3f-4cda-b06d-293a5f2677a6 tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee" acquired by "attach_volume" :: waited 0.031s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-fad42b22-b288-4942-b42a-b31cc2dcb19d" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c373f-61b8-4c79-9810-8a0135ae7887]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b540c09e-0f3f-4cda-b06d-293a5f2677a6 tempest-VolumesActionsTest-1692132607 None] Attaching volume c1144652-c60a-4897-9bb5-6ea7a45e81ee to instance 3b0136f0-c468-4e4c-a5d1-84c8d3ce5b6e at mountpoint /dev/vdb on host None.
Apr 20 23:42:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b540c09e-0f3f-4cda-b06d-293a5f2677a6 tempest-VolumesActionsTest-1692132607 None] Attach volume completed successfully.
Apr 20 23:42:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b540c09e-0f3f-4cda-b06d-293a5f2677a6 tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee" released by "attach_volume" :: held 0.100s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:09 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d
Apr 20 23:42:09 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:10 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Deleted volume successfully.
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c868d55b-ed0a-4ad9-9f39-5590bcd8e649 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-cb63bd8d-5c3f-401c-b672-5ae723b7f450-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:10 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:10 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d
Apr 20 23:42:10 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-16f21bae-0aad-4c76-ab9c-f4aa8daf9d03 tempest-VolumesActionsTest-1692132607 None] Acquiring lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-16f21bae-0aad-4c76-ab9c-f4aa8daf9d03 tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-16f21bae-0aad-4c76-ab9c-f4aa8daf9d03 tempest-VolumesActionsTest-1692132607 None] Detaching volume c1144652-c60a-4897-9bb5-6ea7a45e81ee from instance 3b0136f0-c468-4e4c-a5d1-84c8d3ce5b6e.
Apr 20 23:42:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-16f21bae-0aad-4c76-ab9c-f4aa8daf9d03 tempest-VolumesActionsTest-1692132607 None] Detach volume completed successfully.
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-16f21bae-0aad-4c76-ab9c-f4aa8daf9d03 tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:10 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fad42b22-b288-4942-b42a-b31cc2dcb19d" returned: 0 in 0.411s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-fad42b22-b288-4942-b42a-b31cc2dcb19d" released by "delete_volume" :: held 0.987s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Created reservations ['5a6ea6be-19ee-4ac9-a1bb-67029e508f7b', '66a64bb8-12a7-4fd3-a260-ad4604856587', 'f2e59f13-19be-42d7-a682-78ea2f37c15c', '3982816c-2cc4-4dc6-b5e2-bf0c75ec5428'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:10 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:10 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:11 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Deleted volume successfully.
Apr 20 23:42:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b665a9e2-a364-4ecb-bb5c-80639bd1d084 tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-fad42b22-b288-4942-b42a-b31cc2dcb19d-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-91a21484-8bda-4d8b-811b-edbacf14848b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-91a21484-8bda-4d8b-811b-edbacf14848b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "cinder-quobyte-91a21484-8bda-4d8b-811b-edbacf14848b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-91a21484-8bda-4d8b-811b-edbacf14848b" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:12 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[30379147-fd02-45f8-9618-c5fb9bfa59b3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:12 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b
Apr 20 23:42:12 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:12 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b" returned: 0 in 0.600s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:12 devstack sudo[89986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b
Apr 20 23:42:12 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:13 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-91a21484-8bda-4d8b-811b-edbacf14848b" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-quobyte-91a21484-8bda-4d8b-811b-edbacf14848b" released by "delete_volume" :: held 1.052s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Created reservations ['307ddcb2-3c53-4d36-959c-8747c6a14da2', 'a5860dc5-3d18-43cf-b8f1-7d5fd713bf83', '22ffef41-7074-443c-bcd0-a50165b6851e', '52df1c89-834d-4b4d-9a30-a804f1c9e946'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:13 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:13 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:13 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Deleted volume successfully.
Apr 20 23:42:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4f6c2ebf-f2e4-4fc5-8c8b-d7fbf1ad653f tempest-VolumeDependencyTests-1565816155 None] Lock "cinder-91a21484-8bda-4d8b-811b-edbacf14848b-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Flow 'volume_create_manager' (1de86eeb-93fc-4a70-97b6-d1f8546a2e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f591bb59-2414-4719-a162-dc6db949a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f591bb59-2414-4719-a162-dc6db949a47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1764eaff-24d9-436f-921c-55665a347c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb5557a2b2f45c9bff05b2a823ebe71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:16Z,use_quota=True,user_id='95d2cb4f6d3f4433907447bd4b153993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c439a-e9ff-4db4-90b3-7435a3dbbcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c439a-e9ff-4db4-90b3-7435a3dbbcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497de2b5-34ba-4f22-8d78-e8c49a480e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497de2b5-34ba-4f22-8d78-e8c49a480e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1764eaff-24d9-436f-921c-55665a347c78', 'volume_name': 'volume-1764eaff-24d9-436f-921c-55665a347c78', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66de2c42-9298-4e6d-bfaa-7404bf336fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66de2c42-9298-4e6d-bfaa-7404bf336fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d47bd6-689f-49f8-a93e-6168bd2103d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Volume 1764eaff-24d9-436f-921c-55665a347c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1764eaff-24d9-436f-921c-55665a347c78', 'volume_size': 1}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1764eaff-24d9-436f-921c-55665a347c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb5557a2b2f45c9bff05b2a823ebe71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:16Z,use_quota=True,user_id='95d2cb4f6d3f4433907447bd4b153993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Creating volume 1764eaff-24d9-436f-921c-55665a347c78 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:42:15 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:42:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:15 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78 1073741824
Apr 20 23:42:15 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:16 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78 1073741824" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:16 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78
Apr 20 23:42:16 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:16 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d47bd6-689f-49f8-a93e-6168bd2103d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1764eaff-24d9-436f-921c-55665a347c78', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63410e7-8895-462c-9b50-d2658acdf400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Volume volume-1764eaff-24d9-436f-921c-55665a347c78 (1764eaff-24d9-436f-921c-55665a347c78): created successfully
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63410e7-8895-462c-9b50-d2658acdf400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Flow 'volume_create_manager' (1de86eeb-93fc-4a70-97b6-d1f8546a2e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b4e3c43d-deee-4dad-bff6-33a1ac8bd77e tempest-CinderUnicodeTest-759665360 None] Created volume successfully.
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Flow 'volume_create_manager' (d6de726b-f9c4-43ae-be61-4736031c0846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2727d31b-5734-4fc6-ae69-247db7895a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2727d31b-5734-4fc6-ae69-247db7895a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-197440073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76adc0d-ad6b-48a3-8f45-3853f756c5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb5557a2b2f45c9bff05b2a823ebe71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:18Z,use_quota=True,user_id='95d2cb4f6d3f4433907447bd4b153993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c20669-f907-4b08-8f59-ad019cb0c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c20669-f907-4b08-8f59-ad019cb0c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6cc6ac-484e-448e-80b9-0c52b6570c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6cc6ac-484e-448e-80b9-0c52b6570c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76adc0d-ad6b-48a3-8f45-3853f756c5eb', 'volume_name': 'volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ebac66-a5b6-4710-a998-78addf534358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ebac66-a5b6-4710-a998-78addf534358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dc45e8-dbc5-444a-9484-89982f52cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:18 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Volume b76adc0d-ad6b-48a3-8f45-3853f756c5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb', 'volume_size': 1}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-197440073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76adc0d-ad6b-48a3-8f45-3853f756c5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb5557a2b2f45c9bff05b2a823ebe71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:18Z,use_quota=True,user_id='95d2cb4f6d3f4433907447bd4b153993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Creating volume b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:42:18 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:18 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb 1073741824
Apr 20 23:42:18 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:18 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb 1073741824" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:18 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb
Apr 20 23:42:18 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:19 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.153s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dc45e8-dbc5-444a-9484-89982f52cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1386b357-f6e5-486e-b602-4278f3d00444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f93f791-a8e3-4e9f-ac1b-3894989cb790]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:19 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Volume volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb (b76adc0d-ad6b-48a3-8f45-3853f756c5eb): created successfully
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1386b357-f6e5-486e-b602-4278f3d00444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Flow 'volume_create_manager' (d6de726b-f9c4-43ae-be61-4736031c0846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6bc5c153-2b1e-453c-b075-c8e421d442a5 tempest-CinderUnicodeTest-759665360 None] Created volume successfully.
Apr 20 23:42:19 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:19 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:19 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[41080c3d-a93e-40f6-927f-d93a6f7e567c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:19 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:19 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:20 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.7337dc8f-445b-466d-b8a3-db438a990fe0g2m3yb5k.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:20 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.7337dc8f-445b-466d-b8a3-db438a990fe0g2m3yb5k.img
Apr 20 23:42:20 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:22 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.7337dc8f-445b-466d-b8a3-db438a990fe0g2m3yb5k.img" returned: 0 in 1.889s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a3656-600d-4812-9460-8c6d0d968623]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:22 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:22 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:22 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:22 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.7337dc8f-445b-466d-b8a3-db438a990fe0g2m3yb5k.img {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:42:22 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Converted 1024.00 MB image at 541.78 MB/s
Apr 20 23:42:22 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] 7337dc8f-445b-466d-b8a3-db438a990fe0 was raw, no need to convert to raw {{(pid=82641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.259s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Uploaded volume to glance image-id: 7337dc8f-445b-466d-b8a3-db438a990fe0. {{(pid=82641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.040s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=119,cinder:INSERT=26,cinder:DELETE=7,cinder:SELECT=78 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=103,cinder:INSERT=30,cinder:UPDATE=109,cinder:DELETE=13 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:42:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-30c26b66-a841-438b-b624-959b355cdcb8 tempest-VolumesActionsTest-1692132607 None] Copy volume to image completed successfully.
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Creating offline snapshot 87f07acd-df5b-4a8a-96ae-93f656b1bb9d of volume b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9153dd3-6591-4913-a5c2-ea8cae5d69f1]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:32 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb
Apr 20 23:42:32 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:32 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:33 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d 1G
Apr 20 23:42:33 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:33 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d 1G" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:33 devstack sudo[90090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d
Apr 20 23:42:33 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:33 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:33 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d is being set with open permissions: ugo+rw
Apr 20 23:42:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:33 devstack sudo[90095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d
Apr 20 23:42:33 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:34 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:34 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info
Apr 20 23:42:34 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:34 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info" returned: 0 in 0.399s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:34 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info is being set with open permissions: ugo+rw
Apr 20 23:42:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:34 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info
Apr 20 23:42:34 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:35 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.info" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.157s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[840fc414-9b55-4783-a3bc-fc4d940af407]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-efe16f1a-4a60-4fcd-aa47-35de3064bd45 tempest-CinderUnicodeTest-759665360 None] Create snapshot completed successfully
Apr 20 23:42:35 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:35 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:35 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd2588-031a-4212-b5ba-72e50a25011c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:35 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:35 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-87f07acd-df5b-4a8a-96ae-93f656b1bb9d-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-87f07acd-df5b-4a8a-96ae-93f656b1bb9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-quobyte-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-quobyte-87f07acd-df5b-4a8a-96ae-93f656b1bb9d" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-87f07acd-df5b-4a8a-96ae-93f656b1bb9d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Deleting offline snapshot 87f07acd-df5b-4a8a-96ae-93f656b1bb9d of volume b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] snapshot_file for this snap is: volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b279a9-b85d-48d4-b7e4-4953a5331b0a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:36 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d
Apr 20 23:42:36 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:36 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:36 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img
Apr 20 23:42:36 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:36 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:42:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b1ad0-732e-4491-91e1-5c7390ddc436]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:36 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb
Apr 20 23:42:36 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:37 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" returned: 0 in 1.108s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:37 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d
Apr 20 23:42:37 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:38 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img" returned: 0 in 2.005s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b4d85-c751-4b60-8ca7-4175949630ed]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:38 devstack sudo[90139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:38 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:38 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d" returned: 0 in 0.800s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:38 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d
Apr 20 23:42:38 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:38 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.584s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:42:38 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Converted 1024.00 MB image at 510.37 MB/s
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] 9cd5a4b4-a045-4832-a69e-c15f6bf4dbc4 was raw, converting to qcow2 {{(pid=82641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886e6ac-3d97-4865-9c4f-7c41587c6893]: (4, 'raw') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:38 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb.87f07acd-df5b-4a8a-96ae-93f656b1bb9d" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-87f07acd-df5b-4a8a-96ae-93f656b1bb9d" released by "_delete_snapshot" :: held 2.850s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" released by "delete_snapshot" :: held 2.861s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Created reservations ['13023e61-0769-4249-a4be-67c9b3ea214b', '3246a8b8-987b-45af-9cf6-cd31a30d4124', '39349bfb-7223-4d54-92b6-bce1ec413f45', '45ec1c75-b8f1-4574-bcf8-bae74ecda371'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:38 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img
Apr 20 23:42:38 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Delete snapshot completed successfully.
Apr 20 23:42:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef5bc931-394e-41c8-86f2-921199373504 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-87f07acd-df5b-4a8a-96ae-93f656b1bb9d-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-b76adc0d-ad6b-48a3-8f45-3853f756c5eb-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-b76adc0d-ad6b-48a3-8f45-3853f756c5eb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-quobyte-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb78a84f-09c6-4a37-8146-f7b07cfef64f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:39 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:39 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb
Apr 20 23:42:39 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:39 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img
Apr 20 23:42:39 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:39 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:39 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb
Apr 20 23:42:39 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:39 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img" returned: 1 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 23:42:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img /opt/stack/data/cinder/conversion/vol_upload_tvu49exi {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:39 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img /opt/stack/data/cinder/conversion/vol_upload_tvu49exi
Apr 20 23:42:39 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:40 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-b76adc0d-ad6b-48a3-8f45-3853f756c5eb" released by "delete_volume" :: held 0.918s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Created reservations ['7e6f6425-8dab-454f-b542-5ab022f946f5', '8c8057ea-5e37-47b8-8ccf-e5af6ec0f48f', 'c421dc21-e65a-44bb-8a26-2c81d22ece22', '338d9d5f-51a3-4865-91cb-0e6399183792'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:40 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img /opt/stack/data/cinder/conversion/vol_upload_tvu49exi" returned: 0 in 0.425s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Image conversion details: src /opt/stack/data/cinder/conversion/c1144652-c60a-4897-9bb5-6ea7a45e81ee.temp_image.9cd5a4b4-a045-4832-a69e-c15f6bf4dbc44p6j_azb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tvu49exi {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:42:40 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[118dd76d-41bb-4d5a-8dc9-7c87fb979356]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tvu49exi {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:40 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tvu49exi
Apr 20 23:42:40 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:40 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:40 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-1764eaff-24d9-436f-921c-55665a347c78-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-1764eaff-24d9-436f-921c-55665a347c78-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "cinder-quobyte-1764eaff-24d9-436f-921c-55665a347c78" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-1764eaff-24d9-436f-921c-55665a347c78" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3be75b-875b-4907-81d0-8a2521a08875]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:40 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78
Apr 20 23:42:40 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:40 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.428s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Deleted volume successfully.
Apr 20 23:42:40 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c822c78-703a-42f8-ab22-e11d113833d0 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-b76adc0d-ad6b-48a3-8f45-3853f756c5eb-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tvu49exi" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:40 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:40 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78
Apr 20 23:42:40 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:41 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-1764eaff-24d9-436f-921c-55665a347c78" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-quobyte-1764eaff-24d9-436f-921c-55665a347c78" released by "delete_volume" :: held 0.957s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Created reservations ['e8e47e0f-ebd2-4523-9bb7-a12b9d1328fc', 'f7cdabc0-9f58-4156-bd15-077e8b918601', 'be1bdf32-e540-419f-8091-056e2d1e94fa', '582bb039-e82a-4ef1-9004-7497fe5175e2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:41 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:41 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.243s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Uploaded volume to glance image-id: 9cd5a4b4-a045-4832-a69e-c15f6bf4dbc4. {{(pid=82641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 20 23:42:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6cdd3fa3-682b-431e-9190-fc33b83526a2 tempest-VolumesActionsTest-1692132607 None] Copy volume to image completed successfully.
Apr 20 23:42:41 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Deleted volume successfully.
Apr 20 23:42:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-640951cd-a219-4988-954b-3bc847856be1 tempest-CinderUnicodeTest-759665360 None] Lock "cinder-1764eaff-24d9-436f-921c-55665a347c78-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Acquiring lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Acquiring lock "cinder-quobyte-c1144652-c60a-4897-9bb5-6ea7a45e81ee" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Lock "cinder-quobyte-c1144652-c60a-4897-9bb5-6ea7a45e81ee" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[111704a9-dfe7-4ed4-8f8f-58650c8fff48]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:42 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:42 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:43 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.534s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:43 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee
Apr 20 23:42:43 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:43 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-c1144652-c60a-4897-9bb5-6ea7a45e81ee" returned: 0 in 0.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Lock "cinder-quobyte-c1144652-c60a-4897-9bb5-6ea7a45e81ee" released by "delete_volume" :: held 1.003s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Created reservations ['a501e6bb-3fff-4b2f-864d-410da8557974', '2b301e59-f731-44b7-87c7-205454fece6f', '70bbd9ab-ac28-4763-a511-7d4ebdf8c355', '535a7d19-0ad3-4af5-a375-93d3027116ee'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:43 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:43 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:44 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:44 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Deleted volume successfully.
Apr 20 23:42:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8055c001-1060-48b0-be49-cb64eb550d9f tempest-VolumesActionsTest-1692132607 None] Lock "cinder-c1144652-c60a-4897-9bb5-6ea7a45e81ee-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Flow 'volume_create_manager' (46bf14a9-c74f-4ea5-bbbb-42dd4464d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9187503d-7e15-4d11-9ae7-70fe5de47148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9187503d-7e15-4d11-9ae7-70fe5de47148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1861931411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ec457a-2b70-46e5-9361-5e26f95514b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66265cb4d988465696c1e331c67a377f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:52Z,use_quota=True,user_id='ce844f23c1024197892da145f2cb0593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd0c88b-a66c-48bc-8946-8ecbdfdbac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd0c88b-a66c-48bc-8946-8ecbdfdbac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9a5345-ac55-45b4-8a62-4331881ae2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9a5345-ac55-45b4-8a62-4331881ae2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ec457a-2b70-46e5-9361-5e26f95514b9', 'volume_name': 'volume-92ec457a-2b70-46e5-9361-5e26f95514b9', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc25a1de-b17d-47ad-a495-3d40cd19986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc25a1de-b17d-47ad-a495-3d40cd19986b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821f0f02-bef6-4e32-b91d-dac4d25c2b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Volume 92ec457a-2b70-46e5-9361-5e26f95514b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ec457a-2b70-46e5-9361-5e26f95514b9', 'volume_size': 2}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1861931411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ec457a-2b70-46e5-9361-5e26f95514b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66265cb4d988465696c1e331c67a377f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:52Z,use_quota=True,user_id='ce844f23c1024197892da145f2cb0593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Creating volume 92ec457a-2b70-46e5-9361-5e26f95514b9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:42:51 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:42:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9 2147483648 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:52 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9 2147483648
Apr 20 23:42:52 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:52 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9 2147483648" returned: 0 in 0.567s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:52 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9
Apr 20 23:42:52 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:53 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821f0f02-bef6-4e32-b91d-dac4d25c2b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ec457a-2b70-46e5-9361-5e26f95514b9', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a47a097-8473-428c-8131-7a201b4da3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Volume volume-92ec457a-2b70-46e5-9361-5e26f95514b9 (92ec457a-2b70-46e5-9361-5e26f95514b9): created successfully
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a47a097-8473-428c-8131-7a201b4da3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Flow 'volume_create_manager' (46bf14a9-c74f-4ea5-bbbb-42dd4464d21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a87d3134-2ec3-4548-b03d-2b76d7a4f786 tempest-VolumesCloneNegativeTest-1113116963 None] Created volume successfully.
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Acquiring lock "cinder-92ec457a-2b70-46e5-9361-5e26f95514b9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "cinder-92ec457a-2b70-46e5-9361-5e26f95514b9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Acquiring lock "cinder-quobyte-92ec457a-2b70-46e5-9361-5e26f95514b9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "cinder-quobyte-92ec457a-2b70-46e5-9361-5e26f95514b9" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ffdfdc-016d-4dba-a456-04d5d21b1d58]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:54 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9
Apr 20 23:42:54 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Flow 'volume_create_manager' (14510aca-f48d-4a2a-aa84-2a68bc974f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32188a23-3784-4f99-bb2c-b3996b1cefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:54 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32188a23-3784-4f99-bb2c-b3996b1cefac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1193551594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b0b1ab-5d1e-4101-bee9-17b998fd4f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bd94c2eff04bb4ba688614880c2899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:55Z,use_quota=True,user_id='d8fbc3e1e2e54f56b9126376438c3b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d848b16-cf51-4c5c-8093-17c776086adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d848b16-cf51-4c5c-8093-17c776086adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa3ac28-0617-4fab-8dc2-16de7dea34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa3ac28-0617-4fab-8dc2-16de7dea34c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b0b1ab-5d1e-4101-bee9-17b998fd4f71', 'volume_name': 'volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade6dde7-42b1-4148-9779-21dda75d8219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade6dde7-42b1-4148-9779-21dda75d8219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e9733-102c-46e4-a57f-2ef08de95a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Volume 37b0b1ab-5d1e-4101-bee9-17b998fd4f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71', 'volume_size': 1}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1193551594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b0b1ab-5d1e-4101-bee9-17b998fd4f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bd94c2eff04bb4ba688614880c2899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:55Z,use_quota=True,user_id='d8fbc3e1e2e54f56b9126376438c3b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Creating volume 37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:42:54 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9" returned: 0 in 0.697s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:54 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 1073741824
Apr 20 23:42:54 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:54 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9
Apr 20 23:42:54 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:55 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-92ec457a-2b70-46e5-9361-5e26f95514b9" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "cinder-quobyte-92ec457a-2b70-46e5-9361-5e26f95514b9" released by "delete_volume" :: held 1.164s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:55 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 1073741824" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Created reservations ['faac7e46-27f2-4983-b6ce-ce7d29d07117', '6b17aea9-71d1-4e76-a48e-43bcd7f64995', 'fbbdcceb-0c68-4267-80d5-82fc3ddfc15f', 'd5600bcc-f3e1-4eab-90c1-85a8739eb743'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:55 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:42:55 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:55 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:42:55 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:55 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e9733-102c-46e4-a57f-2ef08de95a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170d4dc5-9653-4a4d-85d9-7e3a4be6f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Volume volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 (37b0b1ab-5d1e-4101-bee9-17b998fd4f71): created successfully
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170d4dc5-9653-4a4d-85d9-7e3a4be6f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Flow 'volume_create_manager' (14510aca-f48d-4a2a-aa84-2a68bc974f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-01a0f427-ee34-449f-8f6e-a476ffb6f7fd tempest-SnapshotDependencyTests-637599544 None] Created volume successfully.
Apr 20 23:42:55 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:42:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Deleted volume successfully.
Apr 20 23:42:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5f084b14-fd2c-494a-a020-26f03296aeb8 tempest-VolumesCloneNegativeTest-1113116963 None] Lock "cinder-92ec457a-2b70-46e5-9361-5e26f95514b9-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Creating offline snapshot bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 of volume 37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[47332770-26b9-48c8-b276-cbe10d4baaab]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:57 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:42:57 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:57 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:57 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 1G
Apr 20 23:42:57 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Flow 'volume_create_manager' (5fc753f0-1672-4756-9f7e-01b212b4cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27f201e-8ae3-41df-9c07-b0fb68b6df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27f201e-8ae3-41df-9c07-b0fb68b6df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-180885735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c48d79-2795-4b4b-b1a1-253a1b595c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69125ff0ab26438392b4f683b48050f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:58Z,use_quota=True,user_id='5ae2240bfaf24f65be92394fe4d6b21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577f2fae-4ad8-4b8a-966a-58bfc9ea6773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577f2fae-4ad8-4b8a-966a-58bfc9ea6773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a461c-e1eb-4a5d-8bea-9dff4fcf7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a461c-e1eb-4a5d-8bea-9dff4fcf7804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c48d79-2795-4b4b-b1a1-253a1b595c85', 'volume_name': 'volume-12c48d79-2795-4b4b-b1a1-253a1b595c85', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99598c6-6ef2-4255-b4b2-1dea719cdd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99598c6-6ef2-4255-b4b2-1dea719cdd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284e1c0b-3734-4573-b1c7-bf67d089e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:42:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Volume 12c48d79-2795-4b4b-b1a1-253a1b595c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c48d79-2795-4b4b-b1a1-253a1b595c85', 'volume_size': 2}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:58 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 1G" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:58 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58
Apr 20 23:42:58 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:58 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" returned: 0 in 0.432s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:58 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 is being set with open permissions: ugo+rw
Apr 20 23:42:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:58 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58
Apr 20 23:42:58 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:59 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:59 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info
Apr 20 23:42:59 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:59 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:59 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info is being set with open permissions: ugo+rw
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:59 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info
Apr 20 23:42:59 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:59 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.info" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-180885735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c48d79-2795-4b4b-b1a1-253a1b595c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69125ff0ab26438392b4f683b48050f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:42:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:42:58Z,use_quota=True,user_id='5ae2240bfaf24f65be92394fe4d6b21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Creating volume 12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:42:59 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:42:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 2147483648 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:42:59 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 2147483648
Apr 20 23:42:59 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:42:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3f489f5b-de82-4f49-978c-6a57df019e00 tempest-SnapshotDependencyTests-637599544 None] Create snapshot completed successfully
Apr 20 23:43:00 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 2147483648" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:00 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85
Apr 20 23:43:00 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Flow 'volume_create_manager' (f8a88c3c-8dde-48b3-a02a-49aeefb37b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349a7eb6-dbef-4f3f-92ce-65df72e7112d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349a7eb6-dbef-4f3f-92ce-65df72e7112d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccb25ae-6322-4e2d-b16d-489a4cb1495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bd94c2eff04bb4ba688614880c2899',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:01Z,use_quota=True,user_id='d8fbc3e1e2e54f56b9126376438c3b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ccaa8f-83e9-4f73-8802-9c23f1c03a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ccaa8f-83e9-4f73-8802-9c23f1c03a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb30c2-9310-499d-bdf3-368c66c82bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb30c2-9310-499d-bdf3-368c66c82bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ccb25ae-6322-4e2d-b16d-489a4cb1495d', 'volume_name': 'volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d', 'volume_size': 1, 'snapshot_id': 'bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64cc78-ffc8-41c4-ac47-e3a7f6e98059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64cc78-ffc8-41c4-ac47-e3a7f6e98059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ed8031-9a48-4b1e-ae3c-161f42755874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Volume 9ccb25ae-6322-4e2d-b16d-489a4cb1495d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d', 'volume_size': 1, 'snapshot_id': 'bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58'}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:00 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85" returned: 0 in 0.415s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.199s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-quobyte-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284e1c0b-3734-4573-b1c7-bf67d089e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c48d79-2795-4b4b-b1a1-253a1b595c85', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a474e1f-6b19-499e-beb7-a7153920df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Creating volume 9ccb25ae-6322-4e2d-b16d-489a4cb1495d from snapshot bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-quobyte-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Volume volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 (12c48d79-2795-4b4b-b1a1-253a1b595c85): created successfully
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a474e1f-6b19-499e-beb7-a7153920df49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Flow 'volume_create_manager' (5fc753f0-1672-4756-9f7e-01b212b4cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] snapshot: bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58, volume: 9ccb25ae-6322-4e2d-b16d-489a4cb1495d,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:43:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-71547913-1bbf-4b1e-9eb3-fce6ed7c6435 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Created volume successfully.
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[578bc836-7123-4dd2-900c-8049d5088094]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:01 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58
Apr 20 23:43:01 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:01 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d02817-a157-41ff-b784-8e5869a98685]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:01 devstack sudo[90274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:43:01 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:01 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:43:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:01 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d
Apr 20 23:43:01 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:03 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" returned: 0 in 1.995s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d5929-4223-40c7-87d0-e494f6230bb5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:03 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:43:03 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:04 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:43:04 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Converted 1024.00 MB image at 512.85 MB/s
Apr 20 23:43:04 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d is being set with open permissions: ugo+rw
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:04 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d
Apr 20 23:43:04 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:04 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" returned: 0 in 0.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" released by "_copy_volume_from_snapshot" :: held 3.992s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" released by "_create_volume_from_snapshot" :: held 4.019s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.037s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.619s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Creating offline snapshot d1bb3be1-e916-4237-ab95-8bda99939704 of volume 12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ebb135-140d-425f-a446-448b1138afee]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ed8031-9a48-4b1e-ae3c-161f42755874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d', 'volume_size': 1, 'snapshot_id': 'bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092a05d3-a6c3-4382-a4f6-61a8461587d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:04 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Volume volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d (9ccb25ae-6322-4e2d-b16d-489a4cb1495d): created successfully
Apr 20 23:43:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092a05d3-a6c3-4382-a4f6-61a8461587d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Flow 'volume_create_manager' (f8a88c3c-8dde-48b3-a02a-49aeefb37b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-81f371a8-1a26-4ab3-9052-aed76fa5c47c tempest-SnapshotDependencyTests-637599544 None] Created volume successfully.
Apr 20 23:43:05 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85
Apr 20 23:43:05 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:05 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 2G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:05 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 2G
Apr 20 23:43:05 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:05 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 2G" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:05 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704
Apr 20 23:43:05 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-quobyte-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-quobyte-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Deleting offline snapshot bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 of volume 37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] snapshot_file for this snap is: volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16aa929-fec5-4b4f-9457-9ee02f23df78]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:06 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58
Apr 20 23:43:06 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:06 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:06 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 is being set with open permissions: ugo+rw
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:06 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704
Apr 20 23:43:06 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:06 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[480077eb-e956-4939-bedb-1ca05d65c3a8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:06 devstack sudo[90321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:43:06 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:06 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704" returned: 0 in 0.408s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:06 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info
Apr 20 23:43:06 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:06 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:07 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58
Apr 20 23:43:07 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:07 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info" returned: 0 in 0.408s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:07 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info is being set with open permissions: ugo+rw
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:07 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info
Apr 20 23:43:07 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:07 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:07 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58
Apr 20 23:43:07 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:07 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.info" returned: 0 in 0.417s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fba19830-d70b-4093-9b2f-3bf391257a2d tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Create snapshot completed successfully
Apr 20 23:43:07 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71.bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" returned: 0 in 0.415s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58" released by "_delete_snapshot" :: held 1.843s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" released by "delete_snapshot" :: held 1.854s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Created reservations ['afce3349-dfad-4da5-8203-5927aefc942b', 'bd486b2f-4501-4e75-a553-97eb6aaabb2e', 'e0e27e7c-a494-449e-af73-49afa6947b8c', 'd1608863-c275-4fb5-aa4b-de41f0b150fb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Delete snapshot completed successfully.
Apr 20 23:43:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f52b96b6-86a7-4902-8e12-827db2121ea2 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-bb75c3de-0a6d-4880-9d5a-0f7bcb3faf58-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-37b0b1ab-5d1e-4101-bee9-17b998fd4f71-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-37b0b1ab-5d1e-4101-bee9-17b998fd4f71-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-quobyte-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[10793f2c-4435-4719-ae56-e868b604a23c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:08 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:43:08 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "cinder-d1bb3be1-e916-4237-ab95-8bda99939704-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:08 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-d1bb3be1-e916-4237-ab95-8bda99939704-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:08 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "cinder-quobyte-12c48d79-2795-4b4b-b1a1-253a1b595c85" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:08 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-quobyte-12c48d79-2795-4b4b-b1a1-253a1b595c85" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "cinder-quobyte-d1bb3be1-e916-4237-ab95-8bda99939704" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-quobyte-d1bb3be1-e916-4237-ab95-8bda99939704" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Deleting offline snapshot d1bb3be1-e916-4237-ab95-8bda99939704 of volume 12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] snapshot_file for this snap is: volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5a836-e4b4-46b3-be48-5d121c0d7172]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:08 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704
Apr 20 23:43:08 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:09 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-37b0b1ab-5d1e-4101-bee9-17b998fd4f71" released by "delete_volume" :: held 0.920s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Created reservations ['bb1ef708-0388-439f-949f-def15fb763b4', 'bb60ea35-aa96-4d7d-83ed-8bd8a312adf4', '1d4cdea7-94d8-40a5-852b-f85285242a2b', '087f8c90-ac46-4762-852c-35a3bb06e191'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:09 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:09 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:09 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c48d79-2795-4b4b-b1a1-253a1b595c85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4327a6-f59d-45bc-9382-382a9b56111a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-9ccb25ae-6322-4e2d-b16d-489a4cb1495d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-9ccb25ae-6322-4e2d-b16d-489a4cb1495d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:09 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85
Apr 20 23:43:09 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "cinder-quobyte-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[843acce9-a9d9-43d2-9c27-1b1d4b0258e5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:09 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d
Apr 20 23:43:09 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:09 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Deleted volume successfully.
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6c80fd9b-73c2-454a-85e6-e0b621e4bb91 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-37b0b1ab-5d1e-4101-bee9-17b998fd4f71-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:09 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:09 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704
Apr 20 23:43:09 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:09 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" returned: 0 in 0.485s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:09 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d
Apr 20 23:43:09 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:10 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:10 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704
Apr 20 23:43:10 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:10 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" returned: 0 in 0.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-quobyte-9ccb25ae-6322-4e2d-b16d-489a4cb1495d" released by "delete_volume" :: held 0.920s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Created reservations ['a7ff6a1f-e8d4-4a5e-9524-9e596441b786', 'c96ed381-1883-411d-be4c-f7ddbd5098d0', '1ee7dd27-b17a-4ca3-be9b-9c25f8ef54b4', '6b398d77-0b24-4d6f-8166-d330843ec7e2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:10 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:10 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:10 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85.d1bb3be1-e916-4237-ab95-8bda99939704" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-quobyte-d1bb3be1-e916-4237-ab95-8bda99939704" released by "_delete_snapshot" :: held 1.909s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-quobyte-12c48d79-2795-4b4b-b1a1-253a1b595c85" released by "delete_snapshot" :: held 1.921s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Created reservations ['737a85d3-b3fe-42af-800b-3fbad2ea2897', '12ab1699-6283-44ee-9da6-bb4a99625e0f', '2a6bb946-46c3-42b8-a68f-52fc29cba11d', 'bcccdf82-cb21-4b2e-940d-96dad0018a3f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Delete snapshot completed successfully.
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-93f67e86-2cab-4427-b91b-3912d85faab6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-d1bb3be1-e916-4237-ab95-8bda99939704-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:10 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Deleted volume successfully.
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-274f334d-8460-406b-8144-bb58a474ac48 tempest-SnapshotDependencyTests-637599544 None] Lock "cinder-9ccb25ae-6322-4e2d-b16d-489a4cb1495d-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "cinder-12c48d79-2795-4b4b-b1a1-253a1b595c85-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-12c48d79-2795-4b4b-b1a1-253a1b595c85-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "cinder-quobyte-12c48d79-2795-4b4b-b1a1-253a1b595c85" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-quobyte-12c48d79-2795-4b4b-b1a1-253a1b595c85" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[98136f71-4bb5-4bef-807e-b5582296f61e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:10 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85
Apr 20 23:43:10 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:11 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:11 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85
Apr 20 23:43:11 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:11 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-12c48d79-2795-4b4b-b1a1-253a1b595c85" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-quobyte-12c48d79-2795-4b4b-b1a1-253a1b595c85" released by "delete_volume" :: held 0.941s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Created reservations ['91fe165c-cf85-4634-8574-9502d5fba0f3', '1828ae80-150a-4448-be41-4c9552aad56b', '96913fe4-453c-4a3b-a76c-ddb2ac7a1173', '013e8bb9-e65f-4a9f-bce3-dad84a938d97'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:11 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:11 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:12 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Deleted volume successfully.
Apr 20 23:43:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-36160228-e6d7-45c3-b6bf-e7b6f58654c6 tempest-VolumesSnapshotNegativeTestJSON-1894277779 None] Lock "cinder-12c48d79-2795-4b4b-b1a1-253a1b595c85-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:15 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:15 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:16 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:21 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=70,cinder:DELETE=10,cinder:INSERT=19,cinder:UPDATE=94 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (425007bb-3f9a-4d03-9208-cb86dfd359d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8609766-ae40-46da-9c41-b3d85e7d124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8609766-ae40-46da-9c41-b3d85e7d124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1384411975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3a6d908e481c9d4dfba011472cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:22Z,use_quota=True,user_id='c5fc51ec4aa744328978d95167803730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a0596e-499f-4c85-ac08-e748e3c3ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a0596e-499f-4c85-ac08-e748e3c3ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379f809f-23cb-4fe2-9707-7a4a26f87eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379f809f-23cb-4fe2-9707-7a4a26f87eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a', 'volume_name': 'volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c6b249-b1e6-4d7b-89ae-6806ad660ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c6b249-b1e6-4d7b-89ae-6806ad660ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a77d8f-6688-4fc7-991d-ffbb7208378c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Volume 6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a', 'volume_size': 1}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1384411975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3a6d908e481c9d4dfba011472cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:22Z,use_quota=True,user_id='c5fc51ec4aa744328978d95167803730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Creating volume 6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:22 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:22 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a 1073741824
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Flow 'volume_create_manager' (b6fb4bfe-dd28-4d0f-860c-e36c7442884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472bd39a-2f40-4ae7-b831-47addd5e9e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472bd39a-2f40-4ae7-b831-47addd5e9e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c250bc-3d52-43fc-88b7-b90f69e66b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567d7c58d69847f9a679c2ffa37bddbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:22Z,use_quota=True,user_id='e09e110f9be74f62ae5b1e498613c268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8902619-3d89-4702-987b-2b4283f5fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8902619-3d89-4702-987b-2b4283f5fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb0a50b-32dc-44fb-b4d5-29b86c7af5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb0a50b-32dc-44fb-b4d5-29b86c7af5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c250bc-3d52-43fc-88b7-b90f69e66b5f', 'volume_name': 'volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302f9006-8111-4d70-891c-1b45d45ba146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302f9006-8111-4d70-891c-1b45d45ba146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348f88c8-7ad9-4f6b-af45-29ffbecfbfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Volume f7c250bc-3d52-43fc-88b7-b90f69e66b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f', 'volume_size': 1}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (763d827c-fb9d-4fc7-817b-ea3423cd6db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af34be12-d68c-4bbb-a18b-fb90864a92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af34be12-d68c-4bbb-a18b-fb90864a92fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484287570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a57baa9-a519-40de-88ce-14eb44a0820f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:22Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839884d5-74e7-4ed1-bd02-d67d911c3cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839884d5-74e7-4ed1-bd02-d67d911c3cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75cb373-526a-48c5-a806-75d65c47e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75cb373-526a-48c5-a806-75d65c47e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a57baa9-a519-40de-88ce-14eb44a0820f', 'volume_name': 'volume-9a57baa9-a519-40de-88ce-14eb44a0820f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862681d4-8a3a-4b47-a5d5-75b0619bfb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862681d4-8a3a-4b47-a5d5-75b0619bfb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f436eae3-b0e6-4790-8f8e-90a2e95233e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Volume 9a57baa9-a519-40de-88ce-14eb44a0820f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a57baa9-a519-40de-88ce-14eb44a0820f', 'volume_size': 1}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (549f18b3-722b-46ee-b214-aa1d2aa39600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4039ef4d-31b0-45d4-8284-3ef5c9fad808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4039ef4d-31b0-45d4-8284-3ef5c9fad808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-804073247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88bb453-adce-4221-8d84-967bd5ab35b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88bb453-adce-4221-8d84-967bd5ab35b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712c6979-cf58-4a48-9251-4f149ee8fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712c6979-cf58-4a48-9251-4f149ee8fd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b', 'volume_name': 'volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193b548e-b18a-4b05-9690-eed2261de3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193b548e-b18a-4b05-9690-eed2261de3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f86d58d-8e40-418d-80a7-cafe32833bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume 4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b', 'volume_size': 1}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (ebc9607e-1f68-45fb-8b85-d4b0da698fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80de8b26-beb8-44f4-9b58-99963c39df56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80de8b26-beb8-44f4-9b58-99963c39df56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013100023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5c94f4-699e-4450-abd4-7aeff5c596b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa27d81-b19b-4b2b-bf1a-c944afc61166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa27d81-b19b-4b2b-bf1a-c944afc61166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fa97a1-4715-4186-8327-b43ecf58acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fa97a1-4715-4186-8327-b43ecf58acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5c94f4-699e-4450-abd4-7aeff5c596b6', 'volume_name': 'volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4395142e-c6d8-4631-af53-5410f72ad0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4395142e-c6d8-4631-af53-5410f72ad0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d2e7d5-dc88-4bcc-9e45-fcbb6de5c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Volume 7c5c94f4-699e-4450-abd4-7aeff5c596b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6', 'volume_size': 1}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:22 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a 1073741824" returned: 0 in 0.586s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:22 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:22 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (1960e746-e9a3-475b-a13f-233e0287611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad8e6e9-8268-4133-9e5e-77753aa4ca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad8e6e9-8268-4133-9e5e-77753aa4ca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528033137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d3355a-81fd-4744-9e02-ae716544d409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9511f1aa-c628-41eb-8ed2-cc4eb33daf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9511f1aa-c628-41eb-8ed2-cc4eb33daf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ada7dd9-173f-4e9a-af87-9630dd3700d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ada7dd9-173f-4e9a-af87-9630dd3700d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d3355a-81fd-4744-9e02-ae716544d409', 'volume_name': 'volume-89d3355a-81fd-4744-9e02-ae716544d409', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64a9a7a-097e-4be0-ae7c-6dc8f1cf2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64a9a7a-097e-4be0-ae7c-6dc8f1cf2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c219fa-7b1f-4c47-bd96-d89985a1ee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Volume 89d3355a-81fd-4744-9e02-ae716544d409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d3355a-81fd-4744-9e02-ae716544d409', 'volume_size': 1}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (e15d8c6f-13d6-4555-8932-d6cc6c493a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18332370-cb57-4ace-99fe-74e5d01b2caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18332370-cb57-4ace-99fe-74e5d01b2caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139187935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bd9a4b-8292-4431-bb93-1822d03b7156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8583ad4b-f3d2-45ca-b333-a8278872bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8583ad4b-f3d2-45ca-b333-a8278872bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd2a15c-8b5b-4270-98c6-65b6ceddb846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd2a15c-8b5b-4270-98c6-65b6ceddb846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7bd9a4b-8292-4431-bb93-1822d03b7156', 'volume_name': 'volume-f7bd9a4b-8292-4431-bb93-1822d03b7156', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61553355-54c7-4219-b122-fba4665e0c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61553355-54c7-4219-b122-fba4665e0c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4166e9ee-6516-4d48-a23c-a8c7c306cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Volume f7bd9a4b-8292-4431-bb93-1822d03b7156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7bd9a4b-8292-4431-bb93-1822d03b7156', 'volume_size': 1}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (cd024406-2e40-4196-8a41-740f0e615575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0852173-7ef3-4cc4-87b2-15f2cc6ca702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0852173-7ef3-4cc4-87b2-15f2cc6ca702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458943704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a28b6f-5a1c-45b3-baaa-b66df7781913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c989e2-18ad-4c30-aef4-d3eec5526740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c989e2-18ad-4c30-aef4-d3eec5526740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4c56a5-5255-42aa-b06c-1aeb08054385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4c56a5-5255-42aa-b06c-1aeb08054385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a28b6f-5a1c-45b3-baaa-b66df7781913', 'volume_name': 'volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd278d69-bcfc-44c9-8e77-781680497c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd278d69-bcfc-44c9-8e77-781680497c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a276af2f-6e7e-4f54-a207-c44187398fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Volume b8a28b6f-5a1c-45b3-baaa-b66df7781913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913', 'volume_size': 1}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c250bc-3d52-43fc-88b7-b90f69e66b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567d7c58d69847f9a679c2ffa37bddbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:22Z,use_quota=True,user_id='e09e110f9be74f62ae5b1e498613c268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Creating volume f7c250bc-3d52-43fc-88b7-b90f69e66b5f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:23 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a77d8f-6688-4fc7-991d-ffbb7208378c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d516590-d4a2-40ad-8c54-707c30b4de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:23 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f 1073741824
Apr 20 23:43:23 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Volume volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a (6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a): created successfully
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d516590-d4a2-40ad-8c54-707c30b4de45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (425007bb-3f9a-4d03-9208-cb86dfd359d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-93c27a68-9204-4283-a4e2-057ffb224be9 tempest-VolumeDependencyTests-257650750 None] Created volume successfully.
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:23 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f 1073741824" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:23 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f
Apr 20 23:43:23 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:24 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f" returned: 0 in 0.399s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484287570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a57baa9-a519-40de-88ce-14eb44a0820f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:22Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Creating volume 9a57baa9-a519-40de-88ce-14eb44a0820f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:24 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348f88c8-7ad9-4f6b-af45-29ffbecfbfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679565e4-c2ff-4df0-92d2-25959bd4d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:24 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f 1073741824
Apr 20 23:43:24 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Volume volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f (f7c250bc-3d52-43fc-88b7-b90f69e66b5f): created successfully
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679565e4-c2ff-4df0-92d2-25959bd4d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Flow 'volume_create_manager' (b6fb4bfe-dd28-4d0f-860c-e36c7442884f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-dde5eec1-bcb3-493b-b682-bc484d538a23 tempest-CinderUnicodeTest-270596415 None] Created volume successfully.
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:24 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Flow 'volume_create_manager' (44ddf455-b3b1-41da-ac64-1d0f002b3fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432691cb-a2cf-4a3c-810f-9995bc17a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f 1073741824" returned: 0 in 0.561s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432691cb-a2cf-4a3c-810f-9995bc17a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-598680775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8937e2-5365-4aeb-b43d-22a04c423ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567d7c58d69847f9a679c2ffa37bddbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:25Z,use_quota=True,user_id='e09e110f9be74f62ae5b1e498613c268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee4fd95-91a0-448b-a4bc-d0acf5537bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee4fd95-91a0-448b-a4bc-d0acf5537bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46718eda-8370-49d9-9d3e-8f4c8398e9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46718eda-8370-49d9-9d3e-8f4c8398e9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8937e2-5365-4aeb-b43d-22a04c423ba8', 'volume_name': 'volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f96dcb-0fe9-4983-bda8-c3df4a181baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f96dcb-0fe9-4983-bda8-c3df4a181baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addb8933-fe24-4821-ba07-ad740d767e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Volume ba8937e2-5365-4aeb-b43d-22a04c423ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8', 'volume_size': 1}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:24 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f
Apr 20 23:43:24 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:25 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.686s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-804073247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating volume 4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:25 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f436eae3-b0e6-4790-8f8e-90a2e95233e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a57baa9-a519-40de-88ce-14eb44a0820f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16845710-a358-4156-bd1b-4f711244d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:25 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b 1073741824
Apr 20 23:43:25 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Volume volume-9a57baa9-a519-40de-88ce-14eb44a0820f (9a57baa9-a519-40de-88ce-14eb44a0820f): created successfully
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16845710-a358-4156-bd1b-4f711244d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (763d827c-fb9d-4fc7-817b-ea3423cd6db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-21538f3f-eba8-44d4-be2c-ad50ea28f88d tempest-CreateVolumesFromImageTest-334536680 None] Created volume successfully.
Apr 20 23:43:25 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b 1073741824" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:25 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b
Apr 20 23:43:25 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:26 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013100023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5c94f4-699e-4450-abd4-7aeff5c596b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Creating volume 7c5c94f4-699e-4450-abd4-7aeff5c596b6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:26 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f86d58d-8e40-418d-80a7-cafe32833bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:26 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 1073741824
Apr 20 23:43:26 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910b16c6-f5bb-41db-8670-d6bbe8cc4471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b (4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b): created successfully
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910b16c6-f5bb-41db-8670-d6bbe8cc4471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (549f18b3-722b-46ee-b214-aa1d2aa39600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-45c13963-ba13-4ddb-8cfc-0ec40b2ce269 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created volume successfully.
Apr 20 23:43:26 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 1073741824" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:26 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6
Apr 20 23:43:26 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:27 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528033137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d3355a-81fd-4744-9e02-ae716544d409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Creating volume 89d3355a-81fd-4744-9e02-ae716544d409 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:27 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d2e7d5-dc88-4bcc-9e45-fcbb6de5c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ac3ac2-1d57-4505-b8a9-3e2cfb3523a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:27 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409 1073741824
Apr 20 23:43:27 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Volume volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 (7c5c94f4-699e-4450-abd4-7aeff5c596b6): created successfully
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ac3ac2-1d57-4505-b8a9-3e2cfb3523a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (ebc9607e-1f68-45fb-8b85-d4b0da698fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9f129c78-d71c-424d-8f3e-57fd153b8cdf tempest-CreateVolumesFromImageTest-334536680 None] Created volume successfully.
Apr 20 23:43:27 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409 1073741824" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:27 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409
Apr 20 23:43:27 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:28 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.963s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139187935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bd9a4b-8292-4431-bb93-1822d03b7156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Creating volume f7bd9a4b-8292-4431-bb93-1822d03b7156 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c219fa-7b1f-4c47-bd96-d89985a1ee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d3355a-81fd-4744-9e02-ae716544d409', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368f149c-9ddc-47e6-92b0-fc9f3e4b90f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:28 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 1073741824
Apr 20 23:43:28 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Volume volume-89d3355a-81fd-4744-9e02-ae716544d409 (89d3355a-81fd-4744-9e02-ae716544d409): created successfully
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368f149c-9ddc-47e6-92b0-fc9f3e4b90f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (1960e746-e9a3-475b-a13f-233e0287611c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1ed70b79-eafe-484a-833a-ad1203d321e0 tempest-CreateVolumesFromImageTest-334536680 None] Created volume successfully.
Apr 20 23:43:28 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 1073741824" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:28 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156
Apr 20 23:43:28 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:29 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.686s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458943704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a28b6f-5a1c-45b3-baaa-b66df7781913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bd5a39d2d34d0892a491515a6088a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:23Z,use_quota=True,user_id='bbfd71d2270042a5a9a001eeb964f68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Creating volume b8a28b6f-5a1c-45b3-baaa-b66df7781913 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:29 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4166e9ee-6516-4d48-a23c-a8c7c306cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bd9a4b-8292-4431-bb93-1822d03b7156', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1149b17a-e750-4d75-b8bc-f13ed37af2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:29 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 1073741824
Apr 20 23:43:29 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Volume volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 (f7bd9a4b-8292-4431-bb93-1822d03b7156): created successfully
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1149b17a-e750-4d75-b8bc-f13ed37af2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (e15d8c6f-13d6-4555-8932-d6cc6c493a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-460d2bf2-acb9-4878-8266-007d311f082d tempest-CreateVolumesFromImageTest-334536680 None] Created volume successfully.
Apr 20 23:43:29 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 1073741824" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:29 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913
Apr 20 23:43:29 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:29 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.289s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a276af2f-6e7e-4f54-a207-c44187398fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d870452-2468-4ecf-b719-dac3253a61d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Creating offline snapshot 76daec8f-b2ac-4e94-abf4-e430dded58ff of volume 6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:43:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Volume volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 (b8a28b6f-5a1c-45b3-baaa-b66df7781913): created successfully
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d870452-2468-4ecf-b719-dac3253a61d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Flow 'volume_create_manager' (cd024406-2e40-4196-8a41-740f0e615575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab118f57-0bc5-4fe8-8cc5-1f8ee69915bf]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e21ebc97-9a46-478f-b10b-8f1d2e8589cb tempest-CreateVolumesFromImageTest-334536680 None] Created volume successfully.
Apr 20 23:43:30 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:30 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:30 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:30 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff 1G
Apr 20 23:43:30 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-b8a28b6f-5a1c-45b3-baaa-b66df7781913-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-b8a28b6f-5a1c-45b3-baaa-b66df7781913-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-quobyte-b8a28b6f-5a1c-45b3-baaa-b66df7781913" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-b8a28b6f-5a1c-45b3-baaa-b66df7781913" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ffc0c-ac13-4e91-9a14-fdb60e46a0fc]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:30 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff 1G" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:31 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff
Apr 20 23:43:31 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:31 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913
Apr 20 23:43:31 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:31 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:31 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff is being set with open permissions: ugo+rw
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:31 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:31 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff
Apr 20 23:43:31 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:31 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913
Apr 20 23:43:31 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:31 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:31 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-b8a28b6f-5a1c-45b3-baaa-b66df7781913" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-b8a28b6f-5a1c-45b3-baaa-b66df7781913" released by "delete_volume" :: held 0.918s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:31 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info
Apr 20 23:43:31 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Created reservations ['2b62c3a7-93fe-406c-9dfc-5eb375870a7f', '0379e2a1-fb92-47ab-b2d9-e1d4ed4c01cf', '529e0a3f-a455-46f4-8e4b-76201fc8e3c8', '32d88d3a-4c7c-467b-a97a-3aa0d59e6197'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:31 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:31 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-f7bd9a4b-8292-4431-bb93-1822d03b7156-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-f7bd9a4b-8292-4431-bb93-1822d03b7156-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-quobyte-f7bd9a4b-8292-4431-bb93-1822d03b7156" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-f7bd9a4b-8292-4431-bb93-1822d03b7156" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[570c2561-4185-4b31-867a-2c049334e287]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:32 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156
Apr 20 23:43:32 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:32 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:32 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info is being set with open permissions: ugo+rw
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:32 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info
Apr 20 23:43:32 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:32 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Deleted volume successfully.
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a965ba40-6972-4bf4-800c-90c8083c8c74 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-b8a28b6f-5a1c-45b3-baaa-b66df7781913-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:32 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:32 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156
Apr 20 23:43:32 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:32 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.info" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.838s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-598680775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8937e2-5365-4aeb-b43d-22a04c423ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567d7c58d69847f9a679c2ffa37bddbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:25Z,use_quota=True,user_id='e09e110f9be74f62ae5b1e498613c268',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Creating volume ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:32 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:32 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=103,cinder:UPDATE=118,cinder:INSERT=32,cinder:DELETE=9 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:43:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f7268932-1bf5-4b5f-977a-86948d7318ab tempest-VolumeDependencyTests-257650750 None] Create snapshot completed successfully
Apr 20 23:43:32 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 1073741824
Apr 20 23:43:32 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:33 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7bd9a4b-8292-4431-bb93-1822d03b7156" returned: 0 in 0.432s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-f7bd9a4b-8292-4431-bb93-1822d03b7156" released by "delete_volume" :: held 0.949s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Created reservations ['4451ed1f-0068-452e-9c4a-abab3338df43', 'd31da74a-9047-4d1d-9e5b-8d656a66a51b', 'd3d393aa-77f6-4afd-aa37-fc457247cd2c', '1171d391-8d63-46d2-b82d-c53e0b2418a7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:33 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:33 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-89d3355a-81fd-4744-9e02-ae716544d409-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-89d3355a-81fd-4744-9e02-ae716544d409-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-quobyte-89d3355a-81fd-4744-9e02-ae716544d409" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-89d3355a-81fd-4744-9e02-ae716544d409" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5819c20-8ef9-4fa8-88f7-16c1f4e89c86]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (045a94cb-f310-4969-be8f-ae18a789e5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c1dd5-d72c-426e-98ef-08d108eb83f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:33 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c1dd5-d72c-426e-98ef-08d108eb83f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466036349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf17557-fa86-4275-a1a7-20b8150b36f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3a6d908e481c9d4dfba011472cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=76daec8f-b2ac-4e94-abf4-e430dded58ff,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:33Z,use_quota=True,user_id='c5fc51ec4aa744328978d95167803730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37cd4f0-cfb1-4de3-a4ee-d610b9283f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:33 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409
Apr 20 23:43:33 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37cd4f0-cfb1-4de3-a4ee-d610b9283f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e0ce30-b6fe-4f90-82d6-ae81af589cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e0ce30-b6fe-4f90-82d6-ae81af589cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcf17557-fa86-4275-a1a7-20b8150b36f2', 'volume_name': 'volume-bcf17557-fa86-4275-a1a7-20b8150b36f2', 'volume_size': 1, 'snapshot_id': '76daec8f-b2ac-4e94-abf4-e430dded58ff'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff55b3d-1693-4e65-baed-f25ff53db42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff55b3d-1693-4e65-baed-f25ff53db42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3e4c5c-b33c-4da1-8647-63446cc5c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Volume bcf17557-fa86-4275-a1a7-20b8150b36f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcf17557-fa86-4275-a1a7-20b8150b36f2', 'volume_size': 1, 'snapshot_id': '76daec8f-b2ac-4e94-abf4-e430dded58ff'}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 1073741824" returned: 0 in 0.632s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:33 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8
Apr 20 23:43:33 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:33 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Deleted volume successfully.
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1793eae0-924d-4d86-9bec-e2615a50e393 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-f7bd9a4b-8292-4431-bb93-1822d03b7156-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:33 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:33 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409
Apr 20 23:43:33 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:33 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.971s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating offline snapshot 8ec963a2-5610-4487-971b-3563d30eeb60 of volume 4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addb8933-fe24-4821-ba07-ad740d767e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ccbf98-fbe8-4439-961b-dcc6822ccad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aca204-ba73-4c3f-9070-1d4f2bbb89bb]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Volume volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 (ba8937e2-5365-4aeb-b43d-22a04c423ba8): created successfully
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ccbf98-fbe8-4439-961b-dcc6822ccad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Flow 'volume_create_manager' (44ddf455-b3b1-41da-ac64-1d0f002b3fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f3da3d92-105b-49f7-8c20-7712c749e29f tempest-CinderUnicodeTest-270596415 None] Created volume successfully.
Apr 20 23:43:33 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b
Apr 20 23:43:33 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:34 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-89d3355a-81fd-4744-9e02-ae716544d409" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-89d3355a-81fd-4744-9e02-ae716544d409" released by "delete_volume" :: held 0.983s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Created reservations ['3dad802a-4557-4cca-b4bd-cd9bbf39d93e', '238fb91c-2274-42ad-bd76-2dfadc169b02', '6666c85d-249a-46a3-8889-e33e68712d27', '96820190-4c9f-4367-a67b-563b07508c1a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:34 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:34 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-7c5c94f4-699e-4450-abd4-7aeff5c596b6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-7c5c94f4-699e-4450-abd4-7aeff5c596b6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:34 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-quobyte-7c5c94f4-699e-4450-abd4-7aeff5c596b6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:34 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 1G
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-7c5c94f4-699e-4450-abd4-7aeff5c596b6" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:34 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d5694-c1d0-4d3d-abe0-22b012760c94]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:34 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6
Apr 20 23:43:34 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:34 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Deleted volume successfully.
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9935a932-f618-4345-bea0-6d5b060d569c tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-89d3355a-81fd-4744-9e02-ae716544d409-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:34 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 1G" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:34 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60
Apr 20 23:43:34 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:34 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:34 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6
Apr 20 23:43:34 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:35 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60" returned: 0 in 0.408s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:35 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 is being set with open permissions: ugo+rw
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:35 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60
Apr 20 23:43:35 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:35 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-7c5c94f4-699e-4450-abd4-7aeff5c596b6" returned: 0 in 0.421s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-7c5c94f4-699e-4450-abd4-7aeff5c596b6" released by "delete_volume" :: held 0.951s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Created reservations ['d4772294-acb3-4909-b0f6-cca64257ec98', '1b1e0c67-15e7-41a2-93a6-54dd626a0bb3', '573de545-fef8-497c-a47f-9bce85349ebb', 'f3555ceb-fa37-4902-9ce2-fb382afd1bcf'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:35 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:35 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-9a57baa9-a519-40de-88ce-14eb44a0820f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-9a57baa9-a519-40de-88ce-14eb44a0820f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "cinder-quobyte-9a57baa9-a519-40de-88ce-14eb44a0820f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-9a57baa9-a519-40de-88ce-14eb44a0820f" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[25174b47-90b8-4aaa-9ec0-d858bce65ae7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:35 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f
Apr 20 23:43:35 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:35 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:35 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info
Apr 20 23:43:35 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:35 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.437s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Deleted volume successfully.
Apr 20 23:43:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7eef4af-44ad-450e-87ef-3762456762fc tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-7c5c94f4-699e-4450-abd4-7aeff5c596b6-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:36 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:36 devstack sudo[90651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f
Apr 20 23:43:36 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:36 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info" returned: 0 in 0.427s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:36 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info is being set with open permissions: ugo+rw
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:36 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info
Apr 20 23:43:36 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:36 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9a57baa9-a519-40de-88ce-14eb44a0820f" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-quobyte-9a57baa9-a519-40de-88ce-14eb44a0820f" released by "delete_volume" :: held 0.897s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Created reservations ['f6efcbf3-471c-4ee9-938f-3336bb83f0e6', '7cc07729-7f76-4b3f-b54e-c2e2b5f92c7c', 'bb020299-9948-48f7-bdbd-95aeeb60841c', '8f45c412-1a75-4b1d-8493-8acc950782bb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:36 devstack sudo[90657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:36 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:36 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.info" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.841s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.300s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-76daec8f-b2ac-4e94-abf4-e430dded58ff-bcf17557-fa86-4275-a1a7-20b8150b36f2" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-eb62fee0-1182-4101-9b7b-acda8f97b43d tempest-CreateVolumesFromSnapshotTest-117064522 None] Create snapshot completed successfully
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-76daec8f-b2ac-4e94-abf4-e430dded58ff-bcf17557-fa86-4275-a1a7-20b8150b36f2" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Creating volume bcf17557-fa86-4275-a1a7-20b8150b36f2 from snapshot 76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-bcf17557-fa86-4275-a1a7-20b8150b36f2" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-bcf17557-fa86-4275-a1a7-20b8150b36f2" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] snapshot: 76daec8f-b2ac-4e94-abf4-e430dded58ff, volume: bcf17557-fa86-4275-a1a7-20b8150b36f2,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce7da50-ff29-4adf-8530-f36c77deb99f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:36 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff
Apr 20 23:43:36 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:36 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Deleted volume successfully.
Apr 20 23:43:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-908f5664-d63e-4b4b-ad0e-f2a887a26745 tempest-CreateVolumesFromImageTest-334536680 None] Lock "cinder-9a57baa9-a519-40de-88ce-14eb44a0820f-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:37 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff" returned: 0 in 0.573s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d5a59b-e8ba-41e4-9845-c25d14e8f063]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:37 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:37 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (7ceb137e-ce7d-45a7-a6a6-5b2e252d288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71da194d-1aba-49ce-90ef-349aa963b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71da194d-1aba-49ce-90ef-349aa963b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1749856035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cbac84-6e48-4331-bd23-5c38e773f313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:37Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16e17a3-4deb-4ead-82d9-c6213bdf595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16e17a3-4deb-4ead-82d9-c6213bdf595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e01d13-98ea-4ef4-846b-98bc521c3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e01d13-98ea-4ef4-846b-98bc521c3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43cbac84-6e48-4331-bd23-5c38e773f313', 'volume_name': 'volume-43cbac84-6e48-4331-bd23-5c38e773f313', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd467f5c-b7f9-4791-b184-9551edc5aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd467f5c-b7f9-4791-b184-9551edc5aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a92e7d4-5889-408d-add8-678556133c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume 43cbac84-6e48-4331-bd23-5c38e773f313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43cbac84-6e48-4331-bd23-5c38e773f313', 'volume_size': 1}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (0a5c99a3-1e6e-4cad-9e35-4f1f6b1cfc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446a3fb5-b084-49b6-81a6-92e79e00e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446a3fb5-b084-49b6-81a6-92e79e00e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-320643588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9673b2f7-90b5-49a2-96eb-7ae7da052dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b34d239-75fe-4fdf-99b9-8fbbf2edb65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b34d239-75fe-4fdf-99b9-8fbbf2edb65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589dcd9c-4d58-421a-8069-212dc6c9adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589dcd9c-4d58-421a-8069-212dc6c9adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9673b2f7-90b5-49a2-96eb-7ae7da052dcc', 'volume_name': 'volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb73fe54-f298-47e0-b1bc-873623c716f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb73fe54-f298-47e0-b1bc-873623c716f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b4d2ee-5fde-4659-8e98-07632697f149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume 9673b2f7-90b5-49a2-96eb-7ae7da052dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc', 'volume_size': 1}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (ffa9808f-fcc5-4bb2-ade3-1c8423f68c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ffa382-b6a6-4907-a46d-947a9bf51cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ffa382-b6a6-4907-a46d-947a9bf51cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1270064676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d74fd53-8013-4d20-9ce0-8283a9fd351b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a70cef8-faf9-4303-9ba4-cdfb92e3cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a70cef8-faf9-4303-9ba4-cdfb92e3cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec6b028-2817-423e-9a85-1b9098b2b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec6b028-2817-423e-9a85-1b9098b2b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d74fd53-8013-4d20-9ce0-8283a9fd351b', 'volume_name': 'volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0ea5e6-a753-4c53-a2b0-ff55ecae76af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0ea5e6-a753-4c53-a2b0-ff55ecae76af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49fb4b9-0026-458b-a8b4-2981a484120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume 0d74fd53-8013-4d20-9ce0-8283a9fd351b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b', 'volume_size': 1}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:37 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.631s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:43:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:38 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2
Apr 20 23:43:38 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (6ea5d450-f02e-4d5a-a409-cba895ae764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4eac2db-6122-4435-8479-9c04cc77f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4eac2db-6122-4435-8479-9c04cc77f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636404988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182fb71b-28d9-4a2c-9681-1daabe480bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6b013-b5a1-4b7c-b304-5109c3dd963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6b013-b5a1-4b7c-b304-5109c3dd963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42919024-ffb0-47bb-87dd-7afc30ccda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42919024-ffb0-47bb-87dd-7afc30ccda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182fb71b-28d9-4a2c-9681-1daabe480bd9', 'volume_name': 'volume-182fb71b-28d9-4a2c-9681-1daabe480bd9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d677c92-f2c0-44f9-821d-27c6b6d6d958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d677c92-f2c0-44f9-821d-27c6b6d6d958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e2f1db-eb59-4b04-ba55-5f1e2668cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume 182fb71b-28d9-4a2c-9681-1daabe480bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182fb71b-28d9-4a2c-9681-1daabe480bd9', 'volume_size': 1}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (a34df665-17da-4ed9-a82c-3aaa35e97046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb863f8-071b-4113-8fa5-22acfdb8c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb863f8-071b-4113-8fa5-22acfdb8c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439087747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9a2453-dc87-4a22-b567-01eaa4ec7d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ae2d80-3fc1-4843-a18a-6a942d9c545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ae2d80-3fc1-4843-a18a-6a942d9c545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66a23d2-7f51-4f3f-8a69-35382806a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66a23d2-7f51-4f3f-8a69-35382806a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9a2453-dc87-4a22-b567-01eaa4ec7d98', 'volume_name': 'volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6060a684-35be-4553-9000-66cbfdf46aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6060a684-35be-4553-9000-66cbfdf46aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9d1f13-e9b8-48d8-a284-4c00c36db7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume ec9a2453-dc87-4a22-b567-01eaa4ec7d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98', 'volume_size': 1}
Apr 20 23:43:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:40 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2" returned: 0 in 2.274s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[52044ef2-0f44-46cd-a2a2-cdfb7b5182a5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:40 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:40 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:40 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.649s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:40 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:43:40 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Converted 1024.00 MB image at 450.08 MB/s
Apr 20 23:43:40 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 is being set with open permissions: ugo+rw
Apr 20 23:43:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:40 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2
Apr 20 23:43:40 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:41 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-bcf17557-fa86-4275-a1a7-20b8150b36f2" released by "_copy_volume_from_snapshot" :: held 4.671s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-76daec8f-b2ac-4e94-abf4-e430dded58ff-bcf17557-fa86-4275-a1a7-20b8150b36f2" released by "_create_volume_from_snapshot" :: held 4.688s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.710s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.850s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Creating offline snapshot cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a of volume ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3e4c5c-b33c-4da1-8647-63446cc5c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf17557-fa86-4275-a1a7-20b8150b36f2', 'volume_size': 1, 'snapshot_id': '76daec8f-b2ac-4e94-abf4-e430dded58ff'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5980e5e-2ba0-4c4a-9a5a-c1b23722757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9db1d0-4eae-4013-a93a-353092c46669]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:41 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Volume volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 (bcf17557-fa86-4275-a1a7-20b8150b36f2): created successfully
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5980e5e-2ba0-4c4a-9a5a-c1b23722757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (045a94cb-f310-4969-be8f-ae18a789e5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ec81c4cb-7bd8-47e0-8a32-ff6d19f8712e tempest-VolumeDependencyTests-257650750 None] Created volume successfully.
Apr 20 23:43:41 devstack sudo[90693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8
Apr 20 23:43:41 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:41 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:42 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a 1G
Apr 20 23:43:42 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-76daec8f-b2ac-4e94-abf4-e430dded58ff-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-76daec8f-b2ac-4e94-abf4-e430dded58ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-76daec8f-b2ac-4e94-abf4-e430dded58ff" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-76daec8f-b2ac-4e94-abf4-e430dded58ff" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Deleting offline snapshot 76daec8f-b2ac-4e94-abf4-e430dded58ff of volume 6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] snapshot_file for this snap is: volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d303954-d584-469e-9fc6-f741f6c05ce3]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:42 devstack sudo[90700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff
Apr 20 23:43:42 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:42 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a 1G" returned: 0 in 0.656s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:42 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a
Apr 20 23:43:42 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:42 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff" returned: 0 in 0.585s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab04922d-8773-4525-9db6-1de45d98ea99]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:42 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:42 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:43 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:43 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a is being set with open permissions: ugo+rw
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:43 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a
Apr 20 23:43:43 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:43 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:43 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff
Apr 20 23:43:43 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:43 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" returned: 0 in 0.532s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:43 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:43 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info
Apr 20 23:43:43 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:43 devstack sudo[90728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff
Apr 20 23:43:43 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:44 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info is being set with open permissions: ugo+rw
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:44 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info
Apr 20 23:43:44 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:44 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a.76daec8f-b2ac-4e94-abf4-e430dded58ff" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-76daec8f-b2ac-4e94-abf4-e430dded58ff" released by "_delete_snapshot" :: held 2.143s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" released by "delete_snapshot" :: held 2.156s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Created reservations ['00ea9329-ed0a-4c2b-87f8-c62120d439fd', '85e50158-728d-4ff6-b540-9de98813331b', '13b3a2af-02de-4608-87ad-d285ebb5fd32', '974ec118-3d7d-4358-b8ea-b9b8275ead08'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Delete snapshot completed successfully.
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-81cc1260-3c52-4f8f-80c8-dff6da84ce23 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-76daec8f-b2ac-4e94-abf4-e430dded58ff-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:44 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.info" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.118s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1749856035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cbac84-6e48-4331-bd23-5c38e773f313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:37Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating volume 43cbac84-6e48-4331-bd23-5c38e773f313 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:44 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-eda3547d-2d38-4db8-a84d-7bd2509c2cf0 tempest-CinderUnicodeTest-270596415 None] Create snapshot completed successfully
Apr 20 23:43:44 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313 1073741824
Apr 20 23:43:44 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-quobyte-ba8937e2-5365-4aeb-b43d-22a04c423ba8" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-ba8937e2-5365-4aeb-b43d-22a04c423ba8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-quobyte-cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Deleting offline snapshot cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a of volume ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:43:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] snapshot_file for this snap is: volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1739f-a0e1-4a85-9726-a2ada3b68a07]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:45 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a
Apr 20 23:43:45 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:45 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313 1073741824" returned: 0 in 0.537s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:45 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313
Apr 20 23:43:45 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebb9d6-6321-4198-8a9a-b1b717d5e741]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:45 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:45 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:45 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" returned: 0 in 0.638s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2444e5ba-9fc3-4e69-922b-8cc8f42f475f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:45 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.886s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-320643588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9673b2f7-90b5-49a2-96eb-7ae7da052dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating volume 9673b2f7-90b5-49a2-96eb-7ae7da052dcc {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:45 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:45 devstack sudo[90751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8
Apr 20 23:43:45 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a92e7d4-5889-408d-add8-678556133c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43cbac84-6e48-4331-bd23-5c38e773f313', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:45 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc 1073741824
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e972da31-233e-4cd5-b26f-513aa6ef9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:45 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume volume-43cbac84-6e48-4331-bd23-5c38e773f313 (43cbac84-6e48-4331-bd23-5c38e773f313): created successfully
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e972da31-233e-4cd5-b26f-513aa6ef9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (7ceb137e-ce7d-45a7-a6a6-5b2e252d288d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-34944a2c-95d8-40cd-a60c-4b90065ad83a tempest-CreateVolumesFromSnapshotTest-117064522 None] Created volume successfully.
Apr 20 23:43:46 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.830s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:46 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a
Apr 20 23:43:46 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:46 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8" returned: 0 in 0.728s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:46 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a
Apr 20 23:43:46 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:46 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc 1073741824" returned: 0 in 0.748s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:46 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc
Apr 20 23:43:46 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:46 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a" released by "delete_volume" :: held 1.364s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Created reservations ['c2b5dac0-70fe-4012-aa2f-b105d803e2d0', 'f34cad6b-8287-4f0f-a775-88b9a23ee994', '6d2d13e4-e720-4f27-8069-509d74c9ff98', '695a65fe-8822-4ad1-b748-32e9dabb34e4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:46 devstack sudo[90774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:46 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:46 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" returned: 0 in 0.573s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:46 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a
Apr 20 23:43:46 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:47 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc" returned: 0 in 0.622s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.112s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1270064676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d74fd53-8013-4d20-9ce0-8283a9fd351b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating volume 0d74fd53-8013-4d20-9ce0-8283a9fd351b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:47 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b4d2ee-5fde-4659-8e98-07632697f149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9f360-3a97-4e83-a447-4e6537540954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc (9673b2f7-90b5-49a2-96eb-7ae7da052dcc): created successfully
Apr 20 23:43:47 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b 1073741824
Apr 20 23:43:47 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9f360-3a97-4e83-a447-4e6537540954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (0a5c99a3-1e6e-4cad-9e35-4f1f6b1cfc15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-dcf00af6-3045-4452-8511-0dc1e6f318ae tempest-CreateVolumesFromSnapshotTest-117064522 None] Created volume successfully.
Apr 20 23:43:47 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Deleted volume successfully.
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc77dcae-d3e1-425e-b950-055f5dd7daf2 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-6f52e2fc-1577-4beb-9793-b3f5ffa7ee5a-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:47 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8.cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a" released by "_delete_snapshot" :: held 2.538s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-ba8937e2-5365-4aeb-b43d-22a04c423ba8" released by "delete_snapshot" :: held 2.549s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Created reservations ['c90fcd95-1a8b-48b5-9b41-42ff11941a6b', '4289acc5-39ce-47b8-a8bf-3457cfa0c1f7', '567611c7-fb51-49cc-a079-6eabfd54a10b', 'de6a9e0f-b917-4ee6-82f4-77e82396b6ac'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Delete snapshot completed successfully.
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-738b208e-d972-4a4e-a72d-842e76d08468 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-cc0704ad-cb97-4ab1-8d6b-459c1e6cd46a-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:47 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b 1073741824" returned: 0 in 0.651s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:47 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b
Apr 20 23:43:47 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (c3438b4d-9bb9-424a-9cee-c60fe593c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d555663f-3ee9-4154-a119-5e9a82783c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d555663f-3ee9-4154-a119-5e9a82783c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177667970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a580f35-13ac-48d2-86d0-a1939186c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3a6d908e481c9d4dfba011472cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:48Z,use_quota=True,user_id='c5fc51ec4aa744328978d95167803730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee9afdd-4d8e-4e6e-9502-1f41dda50bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee9afdd-4d8e-4e6e-9502-1f41dda50bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73ffc74-606f-4470-b7ef-36f3c0e41c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73ffc74-606f-4470-b7ef-36f3c0e41c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a580f35-13ac-48d2-86d0-a1939186c1c4', 'volume_name': 'volume-5a580f35-13ac-48d2-86d0-a1939186c1c4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218c137f-1df5-465d-8a7f-f0c3f6afdd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218c137f-1df5-465d-8a7f-f0c3f6afdd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e611b9-f185-423e-85bd-ea3b2c6af969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Volume 5a580f35-13ac-48d2-86d0-a1939186c1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a580f35-13ac-48d2-86d0-a1939186c1c4', 'volume_size': 1}
Apr 20 23:43:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-ba8937e2-5365-4aeb-b43d-22a04c423ba8-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-ba8937e2-5365-4aeb-b43d-22a04c423ba8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-quobyte-ba8937e2-5365-4aeb-b43d-22a04c423ba8" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-ba8937e2-5365-4aeb-b43d-22a04c423ba8" acquired by "delete_volume" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b246aa-ab39-49d3-ae42-98d230221b79]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:48 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8
Apr 20 23:43:48 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:48 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.048s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636404988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182fb71b-28d9-4a2c-9681-1daabe480bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating volume 182fb71b-28d9-4a2c-9681-1daabe480bd9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:48 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49fb4b9-0026-458b-a8b4-2981a484120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c203a6e9-c459-4a01-af64-d941223d8922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:48 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 1073741824
Apr 20 23:43:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b (0d74fd53-8013-4d20-9ce0-8283a9fd351b): created successfully
Apr 20 23:43:48 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c203a6e9-c459-4a01-af64-d941223d8922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (ffa9808f-fcc5-4bb2-ade3-1c8423f68c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-02fe7b78-1f5a-4ec0-9479-42a605786131 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created volume successfully.
Apr 20 23:43:48 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:48 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8
Apr 20 23:43:48 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:48 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 1073741824" returned: 0 in 0.591s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:48 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9
Apr 20 23:43:48 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:49 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ba8937e2-5365-4aeb-b43d-22a04c423ba8" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-ba8937e2-5365-4aeb-b43d-22a04c423ba8" released by "delete_volume" :: held 1.037s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Created reservations ['58530be1-7b2a-4ab2-955c-3ad76ce6f1d2', '223a32e2-a117-46f2-8002-733181ca5753', 'd22c96f6-f489-4df1-8eeb-d3e26091e465', '339dcbb9-c783-4de1-a432-778e6506cf42'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:49 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:49 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:49 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.960s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439087747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9a2453-dc87-4a22-b567-01eaa4ec7d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587207cb3aa94301b57b475401269e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:38Z,use_quota=True,user_id='f7136d837e714f899444807ac204f407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Creating volume ec9a2453-dc87-4a22-b567-01eaa4ec7d98 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:49 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e2f1db-eb59-4b04-ba55-5f1e2668cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182fb71b-28d9-4a2c-9681-1daabe480bd9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:49 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 1073741824
Apr 20 23:43:49 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b242d594-490d-4a31-a8c0-e64c4c30c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 (182fb71b-28d9-4a2c-9681-1daabe480bd9): created successfully
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b242d594-490d-4a31-a8c0-e64c4c30c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (6ea5d450-f02e-4d5a-a409-cba895ae764c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d751711c-f2c8-4414-85e0-96e2a029b549 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created volume successfully.
Apr 20 23:43:49 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Deleted volume successfully.
Apr 20 23:43:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-beb3c42d-9d03-4b60-8069-2f7a5b099574 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-ba8937e2-5365-4aeb-b43d-22a04c423ba8-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:50 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 1073741824" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:50 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98
Apr 20 23:43:50 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-f7c250bc-3d52-43fc-88b7-b90f69e66b5f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-f7c250bc-3d52-43fc-88b7-b90f69e66b5f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "cinder-quobyte-f7c250bc-3d52-43fc-88b7-b90f69e66b5f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-f7c250bc-3d52-43fc-88b7-b90f69e66b5f" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b730fe0-8dcc-4850-bb03-41d9c449f6ac]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:50 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:50 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1177667970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a580f35-13ac-48d2-86d0-a1939186c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3a6d908e481c9d4dfba011472cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:48Z,use_quota=True,user_id='c5fc51ec4aa744328978d95167803730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Creating volume 5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:43:50 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:43:50 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9d1f13-e9b8-48d8-a284-4c00c36db7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74503777-cc29-44ab-83a8-0786e1136140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:50 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Volume volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 (ec9a2453-dc87-4a22-b567-01eaa4ec7d98): created successfully
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74503777-cc29-44ab-83a8-0786e1136140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:50 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 1073741824
Apr 20 23:43:50 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Flow 'volume_create_manager' (a34df665-17da-4ed9-a82c-3aaa35e97046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-564b2dee-5620-47d8-9d47-b4ba63951d8f tempest-CreateVolumesFromSnapshotTest-117064522 None] Created volume successfully.
Apr 20 23:43:50 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:50 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f
Apr 20 23:43:50 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:51 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 1073741824" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:51 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:43:51 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:51 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-f7c250bc-3d52-43fc-88b7-b90f69e66b5f" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-quobyte-f7c250bc-3d52-43fc-88b7-b90f69e66b5f" released by "delete_volume" :: held 0.993s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-ec9a2453-dc87-4a22-b567-01eaa4ec7d98-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-ec9a2453-dc87-4a22-b567-01eaa4ec7d98-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Created reservations ['d771892e-f4fc-4e3f-8218-4e5b3abce28b', '5d189657-0300-4205-928a-9c5e60cb1270', '071a9f0f-7705-4eac-8936-b59d830410db', '804c99a3-8a3e-4320-baa7-3e60197939bc'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-ec9a2453-dc87-4a22-b567-01eaa4ec7d98" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-ec9a2453-dc87-4a22-b567-01eaa4ec7d98" acquired by "delete_volume" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e9455-4af9-41f4-8dec-d429a999f2c9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:51 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:51 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:51 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98
Apr 20 23:43:51 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:51 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.651s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e611b9-f185-423e-85bd-ea3b2c6af969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a580f35-13ac-48d2-86d0-a1939186c1c4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb12d1a-0d64-49b1-98b2-7afe7a5a0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:51 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Volume volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 (5a580f35-13ac-48d2-86d0-a1939186c1c4): created successfully
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb12d1a-0d64-49b1-98b2-7afe7a5a0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:51 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (c3438b4d-9bb9-424a-9cee-c60fe593c33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3a420d30-ca75-483a-84ec-f8e4d7b184ff tempest-VolumeDependencyTests-257650750 None] Created volume successfully.
Apr 20 23:43:52 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Deleted volume successfully.
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-37eece87-dd1c-4664-a3ad-c71606072503 tempest-CinderUnicodeTest-270596415 None] Lock "cinder-f7c250bc-3d52-43fc-88b7-b90f69e66b5f-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:52 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98" returned: 0 in 0.721s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:52 devstack sudo[90843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98
Apr 20 23:43:52 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (7f3f14d3-e0ed-4bf2-8883-b0e88f62dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cbdce4-3cee-4e0f-8b14-f4756e9feff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cbdce4-3cee-4e0f-8b14-f4756e9feff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-974702929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd7293d-e687-4983-b2d1-0a1c825a35b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653c3a6d908e481c9d4dfba011472cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5a580f35-13ac-48d2-86d0-a1939186c1c4,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:52Z,use_quota=True,user_id='c5fc51ec4aa744328978d95167803730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00f7a97-85f0-415e-9c82-d578f88f6383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00f7a97-85f0-415e-9c82-d578f88f6383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be02bad-f86c-4381-8f2b-ec5e515f11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be02bad-f86c-4381-8f2b-ec5e515f11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ffd7293d-e687-4983-b2d1-0a1c825a35b3', 'volume_name': 'volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3', 'volume_size': 1, 'source_volid': '5a580f35-13ac-48d2-86d0-a1939186c1c4', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453ed83c-458a-423f-8d1a-3e59051d1c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453ed83c-458a-423f-8d1a-3e59051d1c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2708cb-0c09-46c0-9a93-54de8c53fe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Volume ffd7293d-e687-4983-b2d1-0a1c825a35b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3', 'volume_size': 1, 'source_volid': '5a580f35-13ac-48d2-86d0-a1939186c1c4', 'source_volstatus': 'available'}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:52 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Cloning volume 5a580f35-13ac-48d2-86d0-a1939186c1c4 to volume ffd7293d-e687-4983-b2d1-0a1c825a35b3
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Creating offline snapshot 209158a7-5db3-4146-8454-76ccbd0623ae of volume 5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b37d3-f70b-471d-aaaf-f7043bf662c0]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:52 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:43:52 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:52 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ec9a2453-dc87-4a22-b567-01eaa4ec7d98" returned: 0 in 0.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-ec9a2453-dc87-4a22-b567-01eaa4ec7d98" released by "delete_volume" :: held 1.324s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['68db471b-1b55-4b04-b9ec-d7cb4ae16fd1', '58f46456-cfdb-4c1e-8436-0098b37a275a', 'f9a11a01-6d1a-4257-87d0-6a7aeb7a7ac7', 'aa5350fe-15ea-4967-a892-14ada326d5c4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:52 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:53 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:53 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.603s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:53 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae 1G
Apr 20 23:43:53 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:53 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleted volume successfully.
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-92f558b6-95f5-4d15-8914-509de1a04ef3 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-ec9a2453-dc87-4a22-b567-01eaa4ec7d98-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-182fb71b-28d9-4a2c-9681-1daabe480bd9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-182fb71b-28d9-4a2c-9681-1daabe480bd9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-182fb71b-28d9-4a2c-9681-1daabe480bd9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-182fb71b-28d9-4a2c-9681-1daabe480bd9" acquired by "delete_volume" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8fc83b-3c19-44c7-a561-a9115cfb8cbb]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:53 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae 1G" returned: 0 in 0.821s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:53 devstack sudo[90860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae
Apr 20 23:43:53 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:53 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9
Apr 20 23:43:53 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Flow 'volume_create_manager' (1b4b5156-7fb2-4619-9680-d5f2ba8d5fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7078e5d3-2c19-4aae-974d-26230289f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7078e5d3-2c19-4aae-974d-26230289f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1044847368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee1f743-c640-49a3-9d32-7ccd82bf44b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b5fd626f2444db8e77210421277105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:54Z,use_quota=True,user_id='ae6a436360864d9b986fd0e2b72361b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76db890-eab9-4047-988b-e34180471762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76db890-eab9-4047-988b-e34180471762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66adae46-2c69-4e6f-931a-1a5eeb041f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66adae46-2c69-4e6f-931a-1a5eeb041f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee1f743-c640-49a3-9d32-7ccd82bf44b5', 'volume_name': 'volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f3819d-0ea7-486b-b132-beb96cf40ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f3819d-0ea7-486b-b132-beb96cf40ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e470f5a-7459-4fa5-af8b-0eab0b74ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:43:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Volume eee1f743-c640-49a3-9d32-7ccd82bf44b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5', 'volume_size': 1}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:54 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:54 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae is being set with open permissions: ugo+rw
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:54 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae
Apr 20 23:43:54 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:54 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9" returned: 0 in 0.714s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:54 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9
Apr 20 23:43:54 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:54 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:54 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info
Apr 20 23:43:54 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:54 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-182fb71b-28d9-4a2c-9681-1daabe480bd9" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-182fb71b-28d9-4a2c-9681-1daabe480bd9" released by "delete_volume" :: held 1.142s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['2fe65f65-8949-4a7c-a663-f1d92190f38a', 'ad31a931-e352-4aed-8062-47df688e812d', 'fb9bb93f-24ed-4ff7-92aa-ff371d927218', '1e402fb3-84f6-45c4-9648-b5b3a2be4200'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:54 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:54 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:55 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info" returned: 0 in 0.440s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:55 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info is being set with open permissions: ugo+rw
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:55 devstack sudo[90881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info
Apr 20 23:43:55 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:55 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleted volume successfully.
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4846dd0-2398-4923-9918-539e5ae78a3a tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-182fb71b-28d9-4a2c-9681-1daabe480bd9-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:55 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.info" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-ffd7293d-e687-4983-b2d1-0a1c825a35b3" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-ffd7293d-e687-4983-b2d1-0a1c825a35b3" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] snapshot: 209158a7-5db3-4146-8454-76ccbd0623ae, volume: ffd7293d-e687-4983-b2d1-0a1c825a35b3,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ecb2d-756f-470c-942d-955cc02d780e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:55 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae
Apr 20 23:43:55 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-0d74fd53-8013-4d20-9ce0-8283a9fd351b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-0d74fd53-8013-4d20-9ce0-8283a9fd351b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-0d74fd53-8013-4d20-9ce0-8283a9fd351b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-0d74fd53-8013-4d20-9ce0-8283a9fd351b" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c1a3ed-521b-4b0a-8778-0a67ac6762d8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:56 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b
Apr 20 23:43:56 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:56 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a580f35-13ac-48d2-86d0-a1939186c1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f26fa7-064f-452b-b0ad-c3facc172942]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:56 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:43:56 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:56 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:56 devstack sudo[90896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b
Apr 20 23:43:56 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:56 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:56 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3
Apr 20 23:43:56 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:56 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-0d74fd53-8013-4d20-9ce0-8283a9fd351b" returned: 0 in 0.415s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-0d74fd53-8013-4d20-9ce0-8283a9fd351b" released by "delete_volume" :: held 0.912s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['f091605f-0013-4841-9b2d-f710993c3299', '3439322e-b95a-4cf0-a26d-2bfacd151b1b', '3c7843fa-fc54-4bf2-b4e4-4464a2a54243', 'aeb62293-3081-4b7d-af45-4c6102ab6f76'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:56 devstack sudo[90904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:56 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-9673b2f7-90b5-49a2-96eb-7ae7da052dcc-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-9673b2f7-90b5-49a2-96eb-7ae7da052dcc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-9673b2f7-90b5-49a2-96eb-7ae7da052dcc" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-9673b2f7-90b5-49a2-96eb-7ae7da052dcc" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af4ae2-0812-450b-b20d-110764771706]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:57 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc
Apr 20 23:43:57 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:58 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 1.137s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:58 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc" returned: 0 in 0.999s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleted volume successfully.
Apr 20 23:43:58 devstack sudo[90925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc
Apr 20 23:43:58 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7522d45-63c9-4433-81da-b5bd1148f560 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-0d74fd53-8013-4d20-9ce0-8283a9fd351b-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:58 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3" returned: 0 in 2.146s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0cef1-b7f1-4e4b-af1f-dae47505c36d]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:58 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:43:58 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:58 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-9673b2f7-90b5-49a2-96eb-7ae7da052dcc" returned: 0 in 0.865s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-9673b2f7-90b5-49a2-96eb-7ae7da052dcc" released by "delete_volume" :: held 1.886s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:58 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['d2c51933-0cc6-4fd1-91a8-9c5dede1a0b7', '81908c8c-6484-4ed5-a879-55b2815e1dc9', '44c527bb-329c-40e9-9009-49fad5f28f04', 'f16b9af5-e949-49b2-96d0-8267c050b830'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:59 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:43:59 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-43cbac84-6e48-4331-bd23-5c38e773f313-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-43cbac84-6e48-4331-bd23-5c38e773f313-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-43cbac84-6e48-4331-bd23-5c38e773f313" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-43cbac84-6e48-4331-bd23-5c38e773f313" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b79e14-7a23-4229-b4c0-7054372c9c0e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:59 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313
Apr 20 23:43:59 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:59 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:43:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleted volume successfully.
Apr 20 23:43:59 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.631s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:43:59 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Converted 1024.00 MB image at 477.00 MB/s
Apr 20 23:43:59 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 is being set with open permissions: ugo+rw
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78169adb-8bf5-4397-87c4-71c46760851c tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-9673b2f7-90b5-49a2-96eb-7ae7da052dcc-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:59 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3
Apr 20 23:43:59 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:59 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:43:59 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313
Apr 20 23:43:59 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:43:59 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-ffd7293d-e687-4983-b2d1-0a1c825a35b3" released by "_copy_volume_from_snapshot" :: held 4.222s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-209158a7-5db3-4146-8454-76ccbd0623ae" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-209158a7-5db3-4146-8454-76ccbd0623ae" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Deleting offline snapshot 209158a7-5db3-4146-8454-76ccbd0623ae of volume 5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] snapshot_file for this snap is: volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b42e2-3187-4877-99a9-aeab294df55a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:43:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:00 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae
Apr 20 23:44:00 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:00 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-43cbac84-6e48-4331-bd23-5c38e773f313" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-43cbac84-6e48-4331-bd23-5c38e773f313" released by "delete_volume" :: held 0.953s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['61682308-2b30-4240-b2f6-f80cc50912ea', '69032a85-5854-40f3-9cb4-8db866cfe258', 'd15aed3a-3cc5-45fb-9ade-4833a54d7969', '08b8ac50-4dfc-48cf-9e28-ef8c4c8ab816'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:00 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:00 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-8ec963a2-5610-4487-971b-3563d30eeb60-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-8ec963a2-5610-4487-971b-3563d30eeb60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-8ec963a2-5610-4487-971b-3563d30eeb60" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-8ec963a2-5610-4487-971b-3563d30eeb60" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleting offline snapshot 8ec963a2-5610-4487-971b-3563d30eeb60 of volume 4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] snapshot_file for this snap is: volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae46ca0-c83e-470d-ae2d-b8bb96c7cef7]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:00 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a580f35-13ac-48d2-86d0-a1939186c1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0f4da-b36d-47f4-8347-ce929019bdd8]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:00 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60
Apr 20 23:44:00 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:00 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:44:00 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:00 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleted volume successfully.
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f34594c-3178-4a83-aade-4357e033335d tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-43cbac84-6e48-4331-bd23-5c38e773f313-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:00 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60" returned: 0 in 0.515s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68833b-129a-432d-8903-6cbafbdbcd5a]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:01 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:01 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae
Apr 20 23:44:01 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:01 devstack sudo[90965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b
Apr 20 23:44:01 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:01 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:01 devstack sudo[90975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60
Apr 20 23:44:01 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:01 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:01 devstack sudo[90977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae
Apr 20 23:44:01 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:01 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4.209158a7-5db3-4146-8454-76ccbd0623ae" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:01 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-209158a7-5db3-4146-8454-76ccbd0623ae" released by "_delete_snapshot" :: held 1.959s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:01 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60
Apr 20 23:44:01 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.525s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.700s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1044847368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee1f743-c640-49a3-9d32-7ccd82bf44b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b5fd626f2444db8e77210421277105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:43:54Z,use_quota=True,user_id='ae6a436360864d9b986fd0e2b72361b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Creating volume eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2708cb-0c09-46c0-9a93-54de8c53fe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3', 'volume_size': 1, 'source_volid': '5a580f35-13ac-48d2-86d0-a1939186c1c4', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9ea40b-7da3-4fc9-8d45-d75569b12cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:01 devstack sudo[90985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 1073741824
Apr 20 23:44:01 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Volume volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 (ffd7293d-e687-4983-b2d1-0a1c825a35b3): created successfully
Apr 20 23:44:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9ea40b-7da3-4fc9-8d45-d75569b12cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Flow 'volume_create_manager' (7f3f14d3-e0ed-4bf2-8883-b0e88f62dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8467f8a8-920d-45ea-9814-29040b2448b4 tempest-VolumeDependencyTests-257650750 None] Created volume successfully.
Apr 20 23:44:02 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b.8ec963a2-5610-4487-971b-3563d30eeb60" returned: 0 in 0.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-8ec963a2-5610-4487-971b-3563d30eeb60" released by "_delete_snapshot" :: held 1.928s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" released by "delete_snapshot" :: held 1.943s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['36c2c050-7d57-4913-aa37-ce648e6638ea', '8fbe040c-2dee-4a9e-b99c-636b2aa7c296', 'a19bdac8-9263-4e54-a01f-c36fe26c4ab5', '7fc86391-bc2d-4b66-b275-e8d7fb36f3df'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Delete snapshot completed successfully.
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-697b2586-01c3-4579-8972-1d95931339b0 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-8ec963a2-5610-4487-971b-3563d30eeb60-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:02 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 1073741824" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:02 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:02 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "cinder-quobyte-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bfd823-bbba-414c-aa40-d7e0195194b2]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:02 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b
Apr 20 23:44:02 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:02 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e470f5a-7459-4fa5-af8b-0eab0b74ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108f2a85-eac0-427d-bec8-57783b7b4d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-5a580f35-13ac-48d2-86d0-a1939186c1c4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Volume volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 (eee1f743-c640-49a3-9d32-7ccd82bf44b5): created successfully
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108f2a85-eac0-427d-bec8-57783b7b4d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Flow 'volume_create_manager' (1b4b5156-7fb2-4619-9680-d5f2ba8d5fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-5a580f35-13ac-48d2-86d0-a1939186c1c4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a1153638-a7ff-412b-8157-e6eeb4118b60 tempest-SnapshotDependencyTests-809347972 None] Created volume successfully.
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-5a580f35-13ac-48d2-86d0-a1939186c1c4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-5a580f35-13ac-48d2-86d0-a1939186c1c4" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2918ee16-d96f-4d61-8625-1f57ef21cdf5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:03 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:03 devstack sudo[90999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:44:03 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:03 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b
Apr 20 23:44:03 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:03 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:03 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4
Apr 20 23:44:03 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:03 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-quobyte-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b" released by "delete_volume" :: held 0.946s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Created reservations ['33e790b0-0127-4c40-92b5-e5de69738f01', '27c17255-c054-4610-b6f2-651e2e881921', '87578f1f-bb10-4404-bce7-187fc16ad80a', 'cdebec7d-3fee-4e59-9039-ecba4f387f66'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:03 devstack sudo[91009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:03 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:03 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-5a580f35-13ac-48d2-86d0-a1939186c1c4" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-5a580f35-13ac-48d2-86d0-a1939186c1c4" released by "delete_volume" :: held 0.945s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Created reservations ['424e7580-28f0-454c-a7d8-15a938666f2f', 'e5b616b5-3633-44d1-9e47-1abd1cda927b', '5da43b5f-32c9-41b5-a702-173a7287798b', '1fe98ce4-2c7c-4d7d-a857-2173ba13df56'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Creating offline snapshot 05488ad9-e72b-4d0e-a242-96babc074f1d of volume eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb64336f-d74d-46e0-a203-c2ed1713430b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:04 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.532s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-ffd7293d-e687-4983-b2d1-0a1c825a35b3-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:04 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:04 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Deleted volume successfully.
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Lock "cinder-ffd7293d-e687-4983-b2d1-0a1c825a35b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-64bf23d1-b33a-40c2-a245-2c943f9f0434 tempest-CreateVolumesFromSnapshotTest-117064522 None] Lock "cinder-4fa83d8d-f6d1-40a4-af9c-63e5c1bbde7b-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:04 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:04 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-ffd7293d-e687-4983-b2d1-0a1c825a35b3" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-ffd7293d-e687-4983-b2d1-0a1c825a35b3" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d9ccd1-7471-4e96-90a6-cc0bc9c0c5a9]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:04 devstack sudo[91017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3
Apr 20 23:44:04 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:04 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:04 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.660s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Deleted volume successfully.
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27fb889c-b5d1-469b-9df3-e15548e78212 tempest-VolumeDependencyTests-257650750 None] Lock "cinder-5a580f35-13ac-48d2-86d0-a1939186c1c4-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:04 devstack sudo[91026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d 1G
Apr 20 23:44:04 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:04 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:04 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3
Apr 20 23:44:04 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:05 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d 1G" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:05 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d
Apr 20 23:44:05 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:05 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-ffd7293d-e687-4983-b2d1-0a1c825a35b3" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-ffd7293d-e687-4983-b2d1-0a1c825a35b3" released by "delete_volume" :: held 1.062s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Created reservations ['36aea513-7771-4dce-8d22-6629b7d439ee', '6b812540-8cd5-4567-9487-9251cfeb0018', '0392fc40-8d54-4776-8a2c-db4f68bcc924', '945d5643-93d9-4360-bafb-2e3e345d88b4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:05 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:05 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (c90851dd-2057-4a9f-ac75-c872a3a48085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5246bf-14ee-4a6d-bf4b-1a1d2d5b071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5246bf-14ee-4a6d-bf4b-1a1d2d5b071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-806966909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf58b6f-54d3-4242-a755-549971cc7502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:05Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10be5910-65fb-4e0b-9f5d-84791a61d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10be5910-65fb-4e0b-9f5d-84791a61d347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee179418-7101-4059-bd8a-3b9fae99ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee179418-7101-4059-bd8a-3b9fae99ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf58b6f-54d3-4242-a755-549971cc7502', 'volume_name': 'volume-dbf58b6f-54d3-4242-a755-549971cc7502', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6140b69-0153-4cd7-b514-cf709b28af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6140b69-0153-4cd7-b514-cf709b28af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0fe679-71ec-4c69-b052-8eeab7385df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:05 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume dbf58b6f-54d3-4242-a755-549971cc7502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf58b6f-54d3-4242-a755-549971cc7502', 'volume_size': 1}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:05 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 -F qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:05 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d is being set with open permissions: ugo+rw
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:05 devstack sudo[91041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d
Apr 20 23:44:05 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:05 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Deleted volume successfully.
Apr 20 23:44:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1462d938-d19e-4bc6-a623-609e6c5aec3c tempest-VolumeDependencyTests-257650750 None] Lock "cinder-ffd7293d-e687-4983-b2d1-0a1c825a35b3-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:06 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:06 devstack sudo[91045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info
Apr 20 23:44:06 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-bcf17557-fa86-4275-a1a7-20b8150b36f2-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Lock "cinder-bcf17557-fa86-4275-a1a7-20b8150b36f2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Acquiring lock "cinder-quobyte-bcf17557-fa86-4275-a1a7-20b8150b36f2" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-bcf17557-fa86-4275-a1a7-20b8150b36f2" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49efcd-8c0b-49ae-a18e-a1a3b0bcedb5]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:06 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2
Apr 20 23:44:06 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:06 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:06 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info is being set with open permissions: ugo+rw
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:06 devstack sudo[91050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info
Apr 20 23:44:06 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:06 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:06 devstack sudo[91056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2
Apr 20 23:44:06 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:07 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.info" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-806966909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf58b6f-54d3-4242-a755-549971cc7502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:05Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Creating volume dbf58b6f-54d3-4242-a755-549971cc7502 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:07 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:07 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502 1073741824
Apr 20 23:44:07 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-38a0fadb-03bb-4dd2-8714-a8b699d84390 tempest-SnapshotDependencyTests-809347972 None] Create snapshot completed successfully
Apr 20 23:44:07 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-bcf17557-fa86-4275-a1a7-20b8150b36f2" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Lock "cinder-quobyte-bcf17557-fa86-4275-a1a7-20b8150b36f2" released by "delete_volume" :: held 0.963s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Created reservations ['62615a98-f67a-4d64-a4db-98c03c606c5e', '4d6d7946-8f4a-4e46-83b2-ac82522b0619', 'b4400401-cdc3-42f3-b39e-5090e4f34115', 'af6d5fee-a3b3-43cf-958e-f03cfde9c111'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:07 devstack sudo[91064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:07 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:07 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502 1073741824" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:07 devstack sudo[91066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502
Apr 20 23:44:07 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:07 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Deleted volume successfully.
Apr 20 23:44:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-86bb4a63-ee4a-420e-af4b-85743698b02a tempest-VolumeDependencyTests-257650750 None] Lock "cinder-bcf17557-fa86-4275-a1a7-20b8150b36f2-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:08 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0fe679-71ec-4c69-b052-8eeab7385df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf58b6f-54d3-4242-a755-549971cc7502', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f048bb27-b000-410b-8789-53b7b9260870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume volume-dbf58b6f-54d3-4242-a755-549971cc7502 (dbf58b6f-54d3-4242-a755-549971cc7502): created successfully
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f048bb27-b000-410b-8789-53b7b9260870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (c90851dd-2057-4a9f-ac75-c872a3a48085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5528d90f-e04a-4379-83ef-1b579f93b65a tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created volume successfully.
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Flow 'volume_create_manager' (520c16d6-6d90-462a-92ba-c318381abef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db61e9af-ae0d-44f7-85a7-9f369122efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db61e9af-ae0d-44f7-85a7-9f369122efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a2c896-84e2-4418-9b40-be13d446d067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b5fd626f2444db8e77210421277105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05488ad9-e72b-4d0e-a242-96babc074f1d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:08Z,use_quota=True,user_id='ae6a436360864d9b986fd0e2b72361b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73eab747-f3c9-4f4d-a4f8-ffd81ac7b515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73eab747-f3c9-4f4d-a4f8-ffd81ac7b515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4cc040-3da3-4377-93b4-6d692f82f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4cc040-3da3-4377-93b4-6d692f82f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14a2c896-84e2-4418-9b40-be13d446d067', 'volume_name': 'volume-14a2c896-84e2-4418-9b40-be13d446d067', 'volume_size': 1, 'snapshot_id': '05488ad9-e72b-4d0e-a242-96babc074f1d'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcad937-e375-418d-98c7-a1aac6b25a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcad937-e375-418d-98c7-a1aac6b25a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e073b425-9446-44d7-9120-47a1354f9bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Volume 14a2c896-84e2-4418-9b40-be13d446d067: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14a2c896-84e2-4418-9b40-be13d446d067', 'volume_size': 1, 'snapshot_id': '05488ad9-e72b-4d0e-a242-96babc074f1d'}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-quobyte-05488ad9-e72b-4d0e-a242-96babc074f1d-14a2c896-84e2-4418-9b40-be13d446d067" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-05488ad9-e72b-4d0e-a242-96babc074f1d-14a2c896-84e2-4418-9b40-be13d446d067" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Creating volume 14a2c896-84e2-4418-9b40-be13d446d067 from snapshot 05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-quobyte-14a2c896-84e2-4418-9b40-be13d446d067" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-14a2c896-84e2-4418-9b40-be13d446d067" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] snapshot: 05488ad9-e72b-4d0e-a242-96babc074f1d, volume: 14a2c896-84e2-4418-9b40-be13d446d067,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc53fc3-6d3a-4bcb-9779-6d24273d358b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:08 devstack sudo[91071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d
Apr 20 23:44:08 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (42881026-5af8-4501-b94c-b3c0501a41da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6ae11f-8d5e-4126-9b0e-ff2cebcfeeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6ae11f-8d5e-4126-9b0e-ff2cebcfeeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-569552376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa30c6ec-24b4-4f0d-8396-882dbba73753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:09Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36604700-0e11-4fd7-a4de-2517a8190e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36604700-0e11-4fd7-a4de-2517a8190e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33d0cb6-258e-41c9-83fa-7a02be7276a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33d0cb6-258e-41c9-83fa-7a02be7276a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa30c6ec-24b4-4f0d-8396-882dbba73753', 'volume_name': 'volume-fa30c6ec-24b4-4f0d-8396-882dbba73753', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdd12f7-4e44-4d45-84fb-982d41b58c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdd12f7-4e44-4d45-84fb-982d41b58c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6657712d-16a1-42da-b780-4686f6a6840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume fa30c6ec-24b4-4f0d-8396-882dbba73753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa30c6ec-24b4-4f0d-8396-882dbba73753', 'volume_size': 1}
Apr 20 23:44:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (21b69f78-d1f0-4319-8a81-eb2ed9c05c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb927c7-f744-4e9a-80d9-a618d27e2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb927c7-f744-4e9a-80d9-a618d27e2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1659873452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a597aa70-2567-4d67-9560-44bee3d3c243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:09Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8738bd24-f8e3-47f8-9774-e7f6948126b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8738bd24-f8e3-47f8-9774-e7f6948126b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e224bd2e-ea75-4b8d-a758-e8a977c4a288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e224bd2e-ea75-4b8d-a758-e8a977c4a288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a597aa70-2567-4d67-9560-44bee3d3c243', 'volume_name': 'volume-a597aa70-2567-4d67-9560-44bee3d3c243', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62297c02-0d77-48b4-b06c-1480cf614bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62297c02-0d77-48b4-b06c-1480cf614bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb7a275-eae4-4ac8-a40f-32ae5fe493ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume a597aa70-2567-4d67-9560-44bee3d3c243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a597aa70-2567-4d67-9560-44bee3d3c243', 'volume_size': 1}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:09 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] will copy from snapshot at /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae686255-a030-4a34-bd41-62cf55837157]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:09 devstack sudo[91076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:09 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (06dfcb1e-a76d-4258-b6b9-224dbd24cca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f70d73-140f-4ff7-bcd8-e7616746af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f70d73-140f-4ff7-bcd8-e7616746af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053355423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e013e331-7a27-4379-94af-56761038f2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:09Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82da918-c538-40d7-95d9-35ba2ee93e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82da918-c538-40d7-95d9-35ba2ee93e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9084b23-e58e-4d7b-9f96-6a335647520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9084b23-e58e-4d7b-9f96-6a335647520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e013e331-7a27-4379-94af-56761038f2b8', 'volume_name': 'volume-e013e331-7a27-4379-94af-56761038f2b8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdebe9af-8b7e-42d0-816e-629db1e2a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdebe9af-8b7e-42d0-816e-629db1e2a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3928d573-8add-4908-9229-58c1bdee359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume e013e331-7a27-4379-94af-56761038f2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e013e331-7a27-4379-94af-56761038f2b8', 'volume_size': 1}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (02e51e0a-85d5-4138-9934-8368f5ac6585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2b2222-d859-4fdf-873f-a4d625735a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2b2222-d859-4fdf-873f-a4d625735a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377292519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0839584-c49d-4f84-b826-9a2c90b356f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:10Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f642d-4d42-483c-9bb4-42ff520d6515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f642d-4d42-483c-9bb4-42ff520d6515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6919e0ec-3e96-4d6a-86bf-175715702df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6919e0ec-3e96-4d6a-86bf-175715702df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0839584-c49d-4f84-b826-9a2c90b356f4', 'volume_name': 'volume-a0839584-c49d-4f84-b826-9a2c90b356f4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bf8aab-f954-42d5-b959-d497b3b82bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bf8aab-f954-42d5-b959-d497b3b82bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0402f9f5-c27b-43d2-9682-2d404d6eb8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume a0839584-c49d-4f84-b826-9a2c90b356f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0839584-c49d-4f84-b826-9a2c90b356f4', 'volume_size': 1}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (4d60f463-5755-4c96-82fe-328f6b1e89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4ed93d-b881-4322-b8ad-08e1b6dbb4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4ed93d-b881-4322-b8ad-08e1b6dbb4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1180207542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157aa5f9-aa08-49d1-97ff-5a69f5ed44a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:10Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7116cad-fa4b-418f-aedf-803372e50401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7116cad-fa4b-418f-aedf-803372e50401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c78e1e-e49b-4277-aa65-4951b826290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c78e1e-e49b-4277-aa65-4951b826290c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157aa5f9-aa08-49d1-97ff-5a69f5ed44a8', 'volume_name': 'volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2d3a09-7200-4ee0-aa34-328c214112f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2d3a09-7200-4ee0-aa34-328c214112f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f34e84-8ed6-4927-8e10-2d4557e90f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume 157aa5f9-aa08-49d1-97ff-5a69f5ed44a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8', 'volume_size': 1}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:09 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.567s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Path /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 23:44:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:09 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067
Apr 20 23:44:09 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:11 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067" returned: 0 in 2.006s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:11 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dd78c5-d9d3-4287-9a31-44732fe3be75]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:11 devstack sudo[91093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:11 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:12 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.580s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Image conversion details: src /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 23:44:12 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Converted 1024.00 MB image at 510.05 MB/s
Apr 20 23:44:12 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 is being set with open permissions: ugo+rw
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:12 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067
Apr 20 23:44:12 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:12 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067" returned: 0 in 0.417s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-14a2c896-84e2-4418-9b40-be13d446d067" released by "_copy_volume_from_snapshot" :: held 4.231s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-05488ad9-e72b-4d0e-a242-96babc074f1d-14a2c896-84e2-4418-9b40-be13d446d067" released by "_create_volume_from_snapshot" :: held 4.252s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.261s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.838s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-569552376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa30c6ec-24b4-4f0d-8396-882dbba73753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:09Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Creating volume fa30c6ec-24b4-4f0d-8396-882dbba73753 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:12 devstack sudo[91101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 1073741824
Apr 20 23:44:12 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e073b425-9446-44d7-9120-47a1354f9bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a2c896-84e2-4418-9b40-be13d446d067', 'volume_size': 1, 'snapshot_id': '05488ad9-e72b-4d0e-a242-96babc074f1d'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d98974d-6737-487e-8efb-8ad9a2377b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Volume volume-14a2c896-84e2-4418-9b40-be13d446d067 (14a2c896-84e2-4418-9b40-be13d446d067): created successfully
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d98974d-6737-487e-8efb-8ad9a2377b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Flow 'volume_create_manager' (520c16d6-6d90-462a-92ba-c318381abef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-573709e6-5704-4d38-a5cb-60237682d201 tempest-SnapshotDependencyTests-809347972 None] Created volume successfully.
Apr 20 23:44:13 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 1073741824" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:13 devstack sudo[91106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753
Apr 20 23:44:13 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:13 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753" returned: 0 in 0.413s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.529s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1659873452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a597aa70-2567-4d67-9560-44bee3d3c243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:09Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Creating volume a597aa70-2567-4d67-9560-44bee3d3c243 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:13 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6657712d-16a1-42da-b780-4686f6a6840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa30c6ec-24b4-4f0d-8396-882dbba73753', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:13 devstack sudo[91109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243 1073741824
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487fb68f-887d-41d7-bb03-7b0a4662439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:13 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 (fa30c6ec-24b4-4f0d-8396-882dbba73753): created successfully
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487fb68f-887d-41d7-bb03-7b0a4662439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (42881026-5af8-4501-b94c-b3c0501a41da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-82cb34e7-9eb4-4966-8dd9-e0f44b886812 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created volume successfully.
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-05488ad9-e72b-4d0e-a242-96babc074f1d-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-05488ad9-e72b-4d0e-a242-96babc074f1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-quobyte-eee1f743-c640-49a3-9d32-7ccd82bf44b5" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-eee1f743-c640-49a3-9d32-7ccd82bf44b5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-quobyte-05488ad9-e72b-4d0e-a242-96babc074f1d" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-05488ad9-e72b-4d0e-a242-96babc074f1d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Deleting offline snapshot 05488ad9-e72b-4d0e-a242-96babc074f1d of volume eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] snapshot_file for this snap is: volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9065d3-8469-4500-9415-9331b4ec2e1c]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:13 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d
Apr 20 23:44:13 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:14 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243 1073741824" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:14 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243
Apr 20 23:44:14 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:14 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ead58c-187c-4017-a652-01934ee18c0b]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:14 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:14 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:14 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243" returned: 0 in 0.410s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.295s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053355423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e013e331-7a27-4379-94af-56761038f2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:09Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Creating volume e013e331-7a27-4379-94af-56761038f2b8 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:14 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb7a275-eae4-4ac8-a40f-32ae5fe493ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a597aa70-2567-4d67-9560-44bee3d3c243', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:14 devstack sudo[91124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8 1073741824
Apr 20 23:44:14 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8174c965-67a6-46b8-9718-631aa6bed7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume volume-a597aa70-2567-4d67-9560-44bee3d3c243 (a597aa70-2567-4d67-9560-44bee3d3c243): created successfully
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8174c965-67a6-46b8-9718-631aa6bed7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (21b69f78-d1f0-4319-8a81-eb2ed9c05c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c057b14f-5cf4-41a4-b384-978d765d85d7 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created volume successfully.
Apr 20 23:44:14 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:14 devstack sudo[91129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d
Apr 20 23:44:14 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:15 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8 1073741824" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:15 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8
Apr 20 23:44:15 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:15 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:15 devstack sudo[91139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d
Apr 20 23:44:15 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:15 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.059s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377292519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0839584-c49d-4f84-b826-9a2c90b356f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:10Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Creating volume a0839584-c49d-4f84-b826-9a2c90b356f4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:15 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3928d573-8add-4908-9229-58c1bdee359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e013e331-7a27-4379-94af-56761038f2b8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac782fd1-2a68-416c-a623-d924b3271871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:15 devstack sudo[91143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4 1073741824
Apr 20 23:44:15 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume volume-e013e331-7a27-4379-94af-56761038f2b8 (e013e331-7a27-4379-94af-56761038f2b8): created successfully
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac782fd1-2a68-416c-a623-d924b3271871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (06dfcb1e-a76d-4258-b6b9-224dbd24cca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4c912f4f-a55e-4608-b976-9f5497e71776 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created volume successfully.
Apr 20 23:44:15 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5.05488ad9-e72b-4d0e-a242-96babc074f1d" returned: 0 in 0.428s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-05488ad9-e72b-4d0e-a242-96babc074f1d" released by "_delete_snapshot" :: held 1.916s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-eee1f743-c640-49a3-9d32-7ccd82bf44b5" released by "delete_snapshot" :: held 1.933s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Created reservations ['3c793eae-84d8-402f-adbc-55557b0333b0', '082a1686-080a-4ddc-8ef5-8106e533195e', '43930a8c-b70b-40e7-826b-d71a3ad4deb1', 'ad376441-f653-43fe-9bd2-1209d5e2587d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Delete snapshot completed successfully.
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f64a855e-cf9e-48c9-86ed-12aa087c0331 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-05488ad9-e72b-4d0e-a242-96babc074f1d-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:15 devstack sudo[91146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:15 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-eee1f743-c640-49a3-9d32-7ccd82bf44b5-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-eee1f743-c640-49a3-9d32-7ccd82bf44b5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-quobyte-eee1f743-c640-49a3-9d32-7ccd82bf44b5" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-eee1f743-c640-49a3-9d32-7ccd82bf44b5" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd499d9-b7ba-4ae7-a4c8-272619f8f4eb]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:16 devstack sudo[91148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:16 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:16 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4 1073741824" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:16 devstack sudo[91154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4
Apr 20 23:44:16 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:16 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91d92983-ff2b-4194-b721-b64a89dd8c42 None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:16 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:16 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5
Apr 20 23:44:16 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:16 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.914s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f93509a74c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T21:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1180207542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157aa5f9-aa08-49d1-97ff-5a69f5ed44a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6baf2f65c7fe477995dd6b91cff43396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T21:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T21:44:10Z,use_quota=True,user_id='90defbd7b8f64a6b9434eb2e6404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192a5017-0d8e-47fc-8972-d5cd99464499),volume_type_id=192a5017-0d8e-47fc-8972-d5cd99464499)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Creating volume 157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Selected osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 23:44:16 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] casted to osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0402f9f5-c27b-43d2-9682-2d404d6eb8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0839584-c49d-4f84-b826-9a2c90b356f4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:16 devstack sudo[91162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 1073741824
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82d6f09-ba85-4d5b-8f00-f4b15050e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:16 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume volume-a0839584-c49d-4f84-b826-9a2c90b356f4 (a0839584-c49d-4f84-b826-9a2c90b356f4): created successfully
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82d6f09-ba85-4d5b-8f00-f4b15050e314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (02e51e0a-85d5-4138-9934-8368f5ac6585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3843ae89-9a09-4e09-a25c-658a833f7a31 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created volume successfully.
Apr 20 23:44:16 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-eee1f743-c640-49a3-9d32-7ccd82bf44b5" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-eee1f743-c640-49a3-9d32-7ccd82bf44b5" released by "delete_volume" :: held 1.025s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Created reservations ['f3ecbdaa-8147-4f97-96f1-5b1713ea2029', '9dd0376d-0111-4c96-9f36-74f1596b690f', '83b1971f-4806-47c8-ae96-33c1838d4046', '53525d73-f144-4bab-a312-3e94bffaefbf'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:17 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:17 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:17 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 1073741824" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:17 devstack sudo[91170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8
Apr 20 23:44:17 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:17 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Deleted volume successfully.
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-56701c89-d6da-4613-b448-9371e204158f tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-eee1f743-c640-49a3-9d32-7ccd82bf44b5-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:17 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f34e84-8ed6-4927-8e10-2d4557e90f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e76a1e2-287f-48e3-a833-818e6e12b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 23:44:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Volume volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 (157aa5f9-aa08-49d1-97ff-5a69f5ed44a8): created successfully
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e76a1e2-287f-48e3-a833-818e6e12b596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 23:44:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Flow 'volume_create_manager' (4d60f463-5755-4c96-82fe-328f6b1e89ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 23:44:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8cbf8638-8032-450d-8460-6c223c6c9add tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created volume successfully.
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-14a2c896-84e2-4418-9b40-be13d446d067-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-14a2c896-84e2-4418-9b40-be13d446d067-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "cinder-quobyte-14a2c896-84e2-4418-9b40-be13d446d067" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-14a2c896-84e2-4418-9b40-be13d446d067" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a59e789-8c2f-4200-a4ae-17a4b4e8e655]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:18 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067
Apr 20 23:44:18 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-quobyte-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6ffd1c-db12-48fe-823e-2796d22d2bda]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:18 devstack sudo[91183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8
Apr 20 23:44:18 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:18 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:18 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067
Apr 20 23:44:18 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:18 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:18 devstack sudo[91193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8
Apr 20 23:44:18 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:19 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-14a2c896-84e2-4418-9b40-be13d446d067" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-quobyte-14a2c896-84e2-4418-9b40-be13d446d067" released by "delete_volume" :: held 0.928s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Created reservations ['0d0c491e-0416-403a-871f-2da171bb997e', '3cbe9b1c-64ac-4d04-8e91-5c19b90beb8e', '6ca31e28-efb5-48b1-a2cf-102781e8054f', '773dcba8-6a74-45ef-9a14-b978c5ca2079'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:19 devstack sudo[91196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:19 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:19 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8" released by "delete_volume" :: held 1.007s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created reservations ['1d584e18-346f-4052-bff9-6c03ca2aed34', 'e89a132c-c184-4564-b7d2-3c6c60603694', 'eebe4959-c676-4108-bb6b-36a13694862a', 'a6952a18-1a5b-4b75-a9ee-250c9d37268b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:19 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:19 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:19 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Deleted volume successfully.
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ef76fbbb-0f8d-46a8-8f15-556b8c87f2f5 tempest-SnapshotDependencyTests-809347972 None] Lock "cinder-14a2c896-84e2-4418-9b40-be13d446d067-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:19 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Deleted volume successfully.
Apr 20 23:44:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9fd547a3-6230-47f4-aab4-a0a2315f70d2 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-157aa5f9-aa08-49d1-97ff-5a69f5ed44a8-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-a0839584-c49d-4f84-b826-9a2c90b356f4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-a0839584-c49d-4f84-b826-9a2c90b356f4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-quobyte-a0839584-c49d-4f84-b826-9a2c90b356f4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-a0839584-c49d-4f84-b826-9a2c90b356f4" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b921fcb-a8ef-44d1-a944-1e9ef7b15bff]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:20 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4
Apr 20 23:44:20 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:21 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:21 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4
Apr 20 23:44:21 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:21 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a0839584-c49d-4f84-b826-9a2c90b356f4" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-a0839584-c49d-4f84-b826-9a2c90b356f4" released by "delete_volume" :: held 1.093s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created reservations ['ba6bead8-8c61-4837-8773-e6aba2e5c7d8', '09a28090-f79f-41b0-8fb4-f00a2252d8c1', '4ce1732a-9f22-4941-9dc0-cd6fdaf5bdf3', '736ab91a-eb29-44f7-9ba8-64095fb567ae'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:21 devstack sudo[91213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:21 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:22 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Deleted volume successfully.
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-269ccbb2-5648-4e45-a05b-15fc75b6e535 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-a0839584-c49d-4f84-b826-9a2c90b356f4-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-e013e331-7a27-4379-94af-56761038f2b8-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-e013e331-7a27-4379-94af-56761038f2b8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=293,cinder:SELECT=199,cinder:INSERT=63,cinder:DELETE=22 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-quobyte-e013e331-7a27-4379-94af-56761038f2b8" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-e013e331-7a27-4379-94af-56761038f2b8" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e02ab-9858-4e60-8ceb-d94a16200628]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:22 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8
Apr 20 23:44:22 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:23 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:23 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8
Apr 20 23:44:23 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:23 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-e013e331-7a27-4379-94af-56761038f2b8" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-e013e331-7a27-4379-94af-56761038f2b8" released by "delete_volume" :: held 0.994s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created reservations ['630fbd89-3296-455d-b574-3faa42e2ea34', '52caed12-2852-4158-8764-fae034cd03ba', 'ac3a49a5-298b-412b-976f-ad29dcef990e', '58189ec0-d200-4d45-909d-ea94ee3ff9fc'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:23 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:23 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-a597aa70-2567-4d67-9560-44bee3d3c243-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-a597aa70-2567-4d67-9560-44bee3d3c243-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-quobyte-a597aa70-2567-4d67-9560-44bee3d3c243" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-a597aa70-2567-4d67-9560-44bee3d3c243" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0700ef6-d62c-4665-9846-21ba854b9d5f]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:23 devstack sudo[91227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243
Apr 20 23:44:23 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:24 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Deleted volume successfully.
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9d9b6743-43a6-4746-8187-662f03c04373 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-e013e331-7a27-4379-94af-56761038f2b8-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:24 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243" returned: 0 in 0.550s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:24 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243
Apr 20 23:44:24 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:24 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-a597aa70-2567-4d67-9560-44bee3d3c243" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-a597aa70-2567-4d67-9560-44bee3d3c243" released by "delete_volume" :: held 1.062s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:24 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created reservations ['e961af9c-0ef8-4838-b329-1c8569014468', '91068545-96af-4d55-8dce-a85d452dd4a6', 'f6a5f840-2ed7-42c3-afde-d274fc695ab1', 'c2a448db-edff-450f-8c6d-213de2b2b146'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:25 devstack sudo[91237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:25 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:25 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Deleted volume successfully.
Apr 20 23:44:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ebf3760-cf10-4bf4-b955-d921d079247f tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-a597aa70-2567-4d67-9560-44bee3d3c243-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-fa30c6ec-24b4-4f0d-8396-882dbba73753-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-fa30c6ec-24b4-4f0d-8396-882dbba73753-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-quobyte-fa30c6ec-24b4-4f0d-8396-882dbba73753" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-fa30c6ec-24b4-4f0d-8396-882dbba73753" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d2257f-dfba-42fe-ae2c-4d6e18190480]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:26 devstack sudo[91274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753
Apr 20 23:44:26 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:26 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:26 devstack sudo[91279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753
Apr 20 23:44:26 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:26 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-fa30c6ec-24b4-4f0d-8396-882dbba73753" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-fa30c6ec-24b4-4f0d-8396-882dbba73753" released by "delete_volume" :: held 0.875s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created reservations ['860d40b9-045a-437e-8bb2-6861ca99d4d1', 'ec4863f9-33f5-4a9a-843b-a58f41673f85', '65cfa65d-c30e-44b0-b2eb-229bf4b894ec', 'c62c29fe-38f5-4499-9574-b35d83cbf7e0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:27 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:27 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-dbf58b6f-54d3-4242-a755-549971cc7502-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-dbf58b6f-54d3-4242-a755-549971cc7502-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "cinder-quobyte-dbf58b6f-54d3-4242-a755-549971cc7502" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-dbf58b6f-54d3-4242-a755-549971cc7502" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3cc5cf-6201-442e-8544-e89e7a32254e]: (4, 'qcow2') {{(pid=83633) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:27 devstack sudo[91284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502
Apr 20 23:44:27 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:27 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Deleted volume successfully.
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07232520-6bf6-42c8-9846-a7b423a84fe9 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-fa30c6ec-24b4-4f0d-8396-882dbba73753-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:27 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:27 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502
Apr 20 23:44:27 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:28 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172/volume-dbf58b6f-54d3-4242-a755-549971cc7502" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-quobyte-dbf58b6f-54d3-4242-a755-549971cc7502" released by "delete_volume" :: held 0.894s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Created reservations ['e0810107-6c04-4f2e-88fb-f0e7012bfe78', '0de93267-41a6-46ed-a3e9-7e381c86ea07', 'f10b2819-d7fd-422c-8b79-241ee1c3e6b4', 'bec9f75b-18bd-4f2b-8245-671f8c9f94f1'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5e49bd4c-0370-4dd1-a2ad-a3f3a489339b'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 23:44:28 devstack sudo[91294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172
Apr 20 23:44:28 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 23:44:28 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/52f866c1aa712ea68c0ef44ed0dad172" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 23:44:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Deleted volume successfully.
Apr 20 23:44:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-006b98c0-d8b2-499c-acbc-f3bf9a4214d6 tempest-CreateVolumesFromSourceVolumeTest-2131456524 None] Lock "cinder-dbf58b6f-54d3-4242-a755-549971cc7502-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 23:44:38 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 23:44:38 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=185,cinder:UPDATE=245,cinder:DELETE=26,cinder:INSERT=71 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}